mirror of
https://github.com/hpcaitech/ColossalAI.git
synced 2025-09-07 20:10:17 +00:00
* [feat][merge] Support one-behind to reduce bubble time. Add profiling code. * [feat] Update sync model by tensor, fix tMbs problem, add qwen train benchmark. * [feat] Update consumer init to run 32B , update qwen benchmark.