[shardformer] support module saving and loading (#4062)

* [shardformer] support module saving and loading

* polish code
This commit is contained in:
Frank Lee
2023-06-22 11:42:11 +08:00
parent 7740c55c55
commit 8eb09a4c69
19 changed files with 493 additions and 102 deletions

1
test.py Normal file
View File

@@ -0,0 +1 @@
from colossalai.tensor.d_tensor.api import to_distributed_tensor