HELSON dceae85195 Added MoE parallel (#127)

2022-01-07 15:08:36 +08:00

..

__init__.py

Added MoE parallel (#127)

2022-01-07 15:08:36 +08:00

initializer_1d.py

Hotfix/Colossalai layers (#92)

2021-12-29 23:32:10 +08:00

initializer_2d.py

Migrated project

2021-10-28 18:21:23 +02:00

initializer_2p5d.py

Develop/experiments (#59)

2021-12-09 15:08:29 +08:00

initializer_3d.py

Develop/experiments (#59)

2021-12-09 15:08:29 +08:00

initializer_data.py

Migrated project

2021-10-28 18:21:23 +02:00

initializer_model.py

Optimize pipeline schedule (#94)

2021-12-30 15:56:46 +08:00

initializer_moe.py

Added MoE parallel (#127)

2022-01-07 15:08:36 +08:00

initializer_pipeline.py

Optimize pipeline schedule (#94)

2021-12-30 15:56:46 +08:00

initializer_sequence.py

Migrated project

2021-10-28 18:21:23 +02:00

initializer_tensor.py

Migrated project

2021-10-28 18:21:23 +02:00

process_group_initializer.py

Migrated project

2021-10-28 18:21:23 +02:00