ColossalAI/colossalai/zero
Xuanlei Zhao dc003c304c
[moe] merge moe into main (#4978)
* update moe module
* support openmoe
2023-11-02 02:21:24 +00:00
..
gemini [gemini] support gradient accumulation (#4869) 2023-10-17 14:07:21 +08:00
low_level [moe] merge moe into main (#4978) 2023-11-02 02:21:24 +00:00
__init__.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
wrapper.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00