ColossalAI/colossalai/moe at dc583aa576c3e2c98925613ae5cc2f3a9147ce3d - ColossalAI - Gitea: Git with a cup of tea at home

github/ColossalAI

mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-07-16 17:16:14 +00:00

Files

History

botbw dc583aa576 [moe] implement tp

2024-08-01 10:06:59 +08:00

..

__init__.py

[MoE/ZeRO] Moe refactor with zero refactor (#5821 )

2024-06-28 14:00:08 +08:00

_operation.py

[moe] implement tp

2024-08-01 10:06:59 +08:00

load_balance.py

[MoE/ZeRO] Moe refactor with zero refactor (#5821 )

2024-06-28 14:00:08 +08:00

manager.py

fix some typo (#5307 )

2024-01-25 13:56:27 +08:00

utils.py

[MoE/ZeRO] Moe refactor with zero refactor (#5821 )

2024-06-28 14:00:08 +08:00