7 Commits

Author	SHA1	Message	Date
Jiarui Fang	52c6ad26e0	[ColoTensor] reconfig ColoInitContext, decouple default_pg and default_dist_spec. (#1953)	2022-11-15 16:24:16 +08:00
Jiarui Fang	9f4fb3f28a	[ColoTensor] ColoInitContext initialize parameters in shard mode. (#1937)	2022-11-14 16:05:09 +08:00
Jiarui Fang	3ce4463fe6	[utils] remove lazy_memory_allocate from ColoInitContext (#1844)	2022-11-09 11:50:33 +08:00
Jiarui Fang	49832b2344	[refactory] add nn.parallel module (#1068)	2022-06-06 15:34:41 +08:00
ver217	ad536e308e	[tensor] refactor colo-tensor (#992) ... * refactor colo-tensor and update linear op * polish code * polish code * update ops and unit tests * update unit tests * polish code * rename dist_spec module * polish code * polish code * remove unneeded import * fix pipelinable	2022-05-19 12:44:59 +08:00
Jiarui Fang	d01d3b8cb0	colo init context add device attr. (#866)	2022-04-25 14:24:26 +08:00
Jiarui Fang	8789850eea	Init Conext supports lazy allocate model memory (#842)	2022-04-22 18:03:35 +08:00