HELSON dceae85195 Added MoE parallel (#127)

2022-01-07 15:08:36 +08:00

..

data_sampler

update examples and sphnix docs for the new api (#63)

2021-12-13 22:07:01 +08:00

gradient_accumulation

Optimize pipeline schedule (#94)

2021-12-30 15:56:46 +08:00

multi_tensor_apply

update examples and sphnix docs for the new api (#63)

2021-12-13 22:07:01 +08:00

__init__.py

Hotfix/Colossalai layers (#92)

2021-12-29 23:32:10 +08:00

activation_checkpoint.py

Migrated project

2021-10-28 18:21:23 +02:00

checkpointing.py

Support TP-compatible Torch AMP and Update trainer API (#27)

2021-11-18 19:45:06 +08:00

common.py

Added MoE parallel (#127)

2022-01-07 15:08:36 +08:00

cuda.py

Migrated project

2021-10-28 18:21:23 +02:00

memory.py

Layer integration (#83)

2021-12-27 15:04:32 +08:00

timer.py

update examples and sphnix docs for the new api (#63)

2021-12-13 22:07:01 +08:00