mirror of
https://github.com/hpcaitech/ColossalAI.git
synced 2026-07-14 13:48:15 +00:00
* [feat] support hybrid parallel model sync * update consumer and producer * update files * update producer * remove print * update --------- Co-authored-by: duanjunwen <935724073@qq.com> Co-authored-by: YeAnbang <44796419+YeAnbang@users.noreply.github.com> Co-authored-by: Tong Li <tong.li35271158@gmail.com>
Requirements
pip install cupy-cuda12x
python -m cupyx.tools.install_library --cuda 12.x --library nccl