github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-07-16 17:16:14 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
b823c6eec757a03dbc8b48d8bf25a5748e99d770
ColossalAI/applications/ColossalChat/coati/distributed
History
Tong Li b823c6eec7 [feat] Add final save at the end (#6274) 
* add final save

* default 1 episode
2025-04-23 10:03:46 +08:00
..
reward
fix reward score
2025-03-11 10:17:32 +08:00
__init__.py
[chat] add distributed impl (#6210)
2025-02-21 15:24:23 +08:00
comm.py
[chat] add distributed impl (#6210)
2025-02-21 15:24:23 +08:00
consumer.py
[feat] Add final save at the end (#6274)
2025-04-23 10:03:46 +08:00
grpo_consumer.py
[hot-fix] Fix memory leakage bug, support TP+PP (#6258)
2025-04-10 10:52:18 +08:00
inference_backend.py
simplify vllm preprocessing input ids
2025-03-21 15:03:10 +08:00
launch.py
[Distributed RLHF] Integration of PP (#6257)
2025-04-09 13:23:24 +08:00
loss.py
fix vllm
2025-03-19 17:11:10 +08:00
producer.py
[feat] add microbatch forwarding (#6251)
2025-03-28 10:24:58 +08:00
README.md
[chat] add distributed impl (#6210)
2025-02-21 15:24:23 +08:00
utils.py
[Feature] Support Distributed LogProb for GRPO Training (#6247)
2025-03-18 17:47:55 +08:00

README.md

Requirements

pip install cupy-cuda12x
python -m cupyx.tools.install_library --cuda 12.x --library nccl
Reference in New Issue View Git Blame Copy Permalink