4 Commits

Author	SHA1	Message	Date
ver217	ce5a7dcab0	[zero] Update sharded model v2 using sharded param v2 (#323)	2022-03-08 18:18:06 +08:00
Jiarui Fang	cec05b25c9	[zero] update zero context init with the updated test utils (#327)	2022-03-08 14:45:01 +08:00
Jiarui Fang	2f6295bf78	[zero] polish shard strategy (#310) ... * init shard param from shape tuple * add more unitest for shard param * add set_payload method for ShardedParam * [zero] add shareded tensor class * polish code * add shard stratgy * move shard and gather logic to shard strategy from shard tensor. * polish code	2022-03-04 15:35:07 +08:00
Jiarui Fang	88496b5b31	[zero] a shard strategy in granularity of tensor (#307)	2022-03-04 11:59:35 +08:00