ColossalAI/applications/ColossalChat/coati/distributed
2025-04-29 16:57:46 +08:00
..
reward support boxed reward 2025-04-28 17:53:20 +08:00
__init__.py [chat] add distributed impl (#6210) 2025-02-21 15:24:23 +08:00
comm.py [chat] add distributed impl (#6210) 2025-02-21 15:24:23 +08:00
consumer.py fix pp state dict incomplete issue 2025-04-29 16:06:01 +08:00
grpo_consumer.py clean code 2025-04-29 16:57:46 +08:00
inference_backend.py [feat] Support DAPO (#6263) 2025-04-25 17:39:17 +08:00
launch.py clean code 2025-04-29 16:57:46 +08:00
loss.py [feat] Support DAPO (#6263) 2025-04-25 17:39:17 +08:00
producer.py clean code 2025-04-29 16:57:46 +08:00
README.md [chat] add distributed impl (#6210) 2025-02-21 15:24:23 +08:00
utils.py [feat] Support DAPO (#6263) 2025-04-25 17:39:17 +08:00

Requirements

pip install cupy-cuda12x
python -m cupyx.tools.install_library --cuda 12.x --library nccl