github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-07-16 17:16:14 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
b34d707cdca8e998d6aa5aebc5f78d86a0af5db7
ColossalAI/applications/ColossalChat/coati/distributed
History
Tong Li b34d707cdc [feat] Add final save at the end (#6274) 
* add final save

* default 1 episode
2025-08-05 13:59:02 +08:00
..
reward
fix reward score
2025-08-05 13:59:02 +08:00
__init__.py
[chat] add distributed impl (#6210)
2025-08-05 13:59:01 +08:00
comm.py
[chat] add distributed impl (#6210)
2025-08-05 13:59:01 +08:00
consumer.py
[feat] Add final save at the end (#6274)
2025-08-05 13:59:02 +08:00
grpo_consumer.py
[hot-fix] Fix memory leakage bug, support TP+PP (#6258)
2025-08-05 13:59:02 +08:00
inference_backend.py
simplify vllm preprocessing input ids
2025-08-05 13:59:02 +08:00
launch.py
[Distributed RLHF] Integration of PP (#6257)
2025-08-05 13:59:02 +08:00
loss.py
fix vllm
2025-08-05 13:59:02 +08:00
producer.py
[feat] add microbatch forwarding (#6251)
2025-08-05 13:59:02 +08:00
README.md
[chat] add distributed impl (#6210)
2025-08-05 13:59:01 +08:00
utils.py
[Feature] Support Distributed LogProb for GRPO Training (#6247)
2025-08-05 13:59:02 +08:00

README.md

Requirements

pip install cupy-cuda12x
python -m cupyx.tools.install_library --cuda 12.x --library nccl
Reference in New Issue View Git Blame Copy Permalink