HELSON 84fd7c1d4d add moe context, moe utilities and refactor gradient handler (#455)

2022-03-18 16:38:32 +08:00

..

process_group_initializer

fix format ColossalAI\colossalai\context\process_group_initializer

2022-03-11 15:50:28 +08:00

random

add moe context, moe utilities and refactor gradient handler (#455)

2022-03-18 16:38:32 +08:00

__init__.py

add moe context, moe utilities and refactor gradient handler (#455)

2022-03-18 16:38:32 +08:00

config.py

update default logger (#100) (#101)

2022-01-04 20:03:26 +08:00

moe_context.py

add moe context, moe utilities and refactor gradient handler (#455)

2022-03-18 16:38:32 +08:00

parallel_context.py

add moe context, moe utilities and refactor gradient handler (#455)

2022-03-18 16:38:32 +08:00

parallel_mode.py

adapted for sequence parallel (#163)

2022-01-20 13:44:51 +08:00