アマデウス 297b8baae2 [model checkpoint] add gloo groups for cpu tensor communication (#589)

2022-04-01 10:15:52 +08:00

..

__init__.py

[MOE] add unitest for MOE experts layout, gradient handler and kernel (#469)

2022-03-21 13:35:04 +08:00

initializer_1d.py

[model checkpoint] add gloo groups for cpu tensor communication (#589)

2022-04-01 10:15:52 +08:00

initializer_2d.py

[model checkpoint] add gloo groups for cpu tensor communication (#589)

2022-04-01 10:15:52 +08:00

initializer_2p5d.py

[model checkpoint] add gloo groups for cpu tensor communication (#589)

2022-04-01 10:15:52 +08:00

initializer_3d.py

[model checkpoint] add gloo groups for cpu tensor communication (#589)

2022-04-01 10:15:52 +08:00

initializer_data.py

[model checkpoint] add gloo groups for cpu tensor communication (#589)

2022-04-01 10:15:52 +08:00

initializer_model.py

[model checkpoint] add gloo groups for cpu tensor communication (#589)

2022-04-01 10:15:52 +08:00

initializer_pipeline.py

[model checkpoint] add gloo groups for cpu tensor communication (#589)

2022-04-01 10:15:52 +08:00

initializer_sequence.py

[model checkpoint] add gloo groups for cpu tensor communication (#589)

2022-04-01 10:15:52 +08:00

initializer_tensor.py

[model checkpoint] add gloo groups for cpu tensor communication (#589)

2022-04-01 10:15:52 +08:00

process_group_initializer.py

Refactored docstring to google style

2022-03-29 17:17:47 +08:00