ver217 54aabb8da4 [gemini] refactor gemini mgr (#1151) ...

* refactor gemini mgr

* udpate __init__

2022-06-22 11:54:36 +08:00

..

amp

[amp] included dict for type casting of model output (#1102)

2022-06-13 14:18:04 +08:00

builder

[pipeline] refactor the pipeline module (#1087)

2022-06-10 11:27:38 +08:00

cli

[hotfix] fix some bugs caused by size mismatch. (#1011)

2022-05-23 14:02:28 +08:00

communication

[pipeline]refactor ppschedule to support tensor list (#1050)

2022-06-02 13:48:59 +08:00

context

[usability] improved error messages in the context module (#856)

2022-04-25 13:42:31 +08:00

engine

[hotfix]fix some bugs caused by refactored schedule. (#1148)

2022-06-21 22:46:30 +08:00

fx

[fx]add autoparallel passes (#1121)

2022-06-15 16:36:46 +08:00

gemini

[gemini] refactor gemini mgr (#1151)

2022-06-22 11:54:36 +08:00

kernel

[optim] refactor fused sgd (#1134)

2022-06-20 11:19:38 +08:00

logging

[doc] improved docstring in the logging module (#861)

2022-04-25 13:42:00 +08:00

nn

[gemini] refactor gemini mgr (#1151)

2022-06-22 11:54:36 +08:00

pipeline

[pipeline]add customized policy (#1139)

2022-06-21 15:23:41 +08:00

registry

Remove duplication registry (#1078)

2022-06-08 07:47:24 +08:00

tensor

[tensor] dist spec s2s uses all-to-all (#1136)

2022-06-22 11:32:38 +08:00

testing

[test] skip tests when not enough GPUs are detected (#1090)

2022-06-09 17:19:13 +08:00

trainer

fix issue #1080 (#1071)

2022-06-07 17:21:11 +08:00

utils

[tensor] fixed non-serializable colo parameter during model checkpointing (#1153)

2022-06-22 11:43:38 +08:00

zero

[ddp] refactor ColoDDP and ZeroDDP (#1146)

2022-06-21 16:35:23 +08:00

__init__.py

[NFC] polish __init__.py code style (#965)

2022-05-17 10:25:06 +08:00

constants.py

fix typo in constants (#1027)

2022-05-26 08:45:08 +08:00

core.py

[polish] polish singleton and global context (#500)

2022-03-23 18:03:39 +08:00

global_variables.py

[MOE] add unitest for MOE experts layout, gradient handler and kernel (#469)

2022-03-21 13:35:04 +08:00

initialize.py

[ddp] supported customized torch ddp configuration (#1123)

2022-06-15 18:11:53 +08:00