Commit Graph

4 Commits

Author SHA1 Message Date
ver217
ce5a7dcab0 [zero] Update sharded model v2 using sharded param v2 (#323) 2022-03-08 18:18:06 +08:00
Jiarui Fang
cec05b25c9 [zero] update zero context init with the updated test utils (#327) 2022-03-08 14:45:01 +08:00
Jiarui Fang
2f6295bf78 [zero] polish shard strategy (#310)
* init shard param from shape tuple

* add more unitest for shard param

* add set_payload method for ShardedParam

* [zero] add shareded tensor class

* polish code

* add shard stratgy

* move shard and gather logic to shard strategy from shard tensor.

* polish code
2022-03-04 15:35:07 +08:00
Jiarui Fang
88496b5b31 [zero] a shard strategy in granularity of tensor (#307) 2022-03-04 11:59:35 +08:00