HELSON dceae85195 Added MoE parallel (#127)

2022-01-07 15:08:36 +08:00

..

__init__.py

add interleaved pipeline, fix naive amp and update pipeline model initializer (#80)

2021-12-20 23:26:19 +08:00

_base_schedule.py

Added MoE parallel (#127)

2022-01-07 15:08:36 +08:00

_non_pipeline_schedule.py

Optimize pipeline schedule (#94)

2021-12-30 15:56:46 +08:00

_pipeline_schedule.py

add scatter/gather optim for pipeline (#123)

2022-01-07 13:22:22 +08:00