github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-08-24 10:41:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
feat/hybrid_model_sync
ColossalAI/applications/ColossalChat/coati/distributed
History
YeAnbang b2362ed33e
Merge branch 'feat/hybrid_model_sync' into support_hybrid_model_sync
2025-04-29 18:22:13 +08:00
..
reward [feat] Support boxed math reward (#6284) 2025-04-29 16:46:47 +08:00
__init__.py [chat] add distributed impl (#6210) 2025-02-21 15:24:23 +08:00
comm.py [chat] add distributed impl (#6210) 2025-02-21 15:24:23 +08:00
consumer.py Merge branch 'feat/hybrid_model_sync' into support_hybrid_model_sync 2025-04-29 18:22:13 +08:00
grpo_consumer.py [feat] Support boxed math reward (#6284) 2025-04-29 16:46:47 +08:00
inference_backend.py [feat] Support DAPO (#6263) 2025-04-25 17:39:17 +08:00
launch.py [feat] support hybrid parallel model sync 2025-04-29 17:00:31 +08:00
loss.py [feat] Support DAPO (#6263) 2025-04-25 17:39:17 +08:00
producer.py [feat] support hybrid parallel model sync 2025-04-29 17:00:31 +08:00
README.md [chat] add distributed impl (#6210) 2025-02-21 15:24:23 +08:00
utils.py [feat] Support DAPO (#6263) 2025-04-25 17:39:17 +08:00

README.md

Requirements

pip install cupy-cuda12x
python -m cupyx.tools.install_library --cuda 12.x --library nccl