mirror of
https://github.com/hpcaitech/ColossalAI.git
synced 2025-09-10 13:30:19 +00:00
* [feat][merge] Support one-behind to reduce bubble time. Add profiling code. * [feat] Update sync model by tensor, fix tMbs problem, add qwen train benchmark. * [feat] Update consumer init to run 32B , update qwen benchmark.
Symbolic link
1 line
17 B
Python
Symbolic link
1 line
17 B
Python
../model_utils.py |