github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-08-22 01:42:54 +00:00
Code Issues Packages Projects Releases Wiki Activity
grpo-profile
ColossalAI/applications/ColossalChat/coati/distributed
History
YeAnbang 2db255bf15 add profiling, implement memory efficient logprob alculation
2025-06-18 10:08:22 +00:00
..
reward support code generation tasks 2025-06-05 18:05:22 +08:00
__init__.py
comm.py
consumer.py add profiling, implement memory efficient logprob alculation 2025-06-18 10:08:22 +00:00
grpo_consumer.py add profiling, implement memory efficient logprob alculation 2025-06-18 10:08:22 +00:00
inference_backend.py support code generation tasks 2025-06-05 18:05:22 +08:00
launch.py add profiling 2025-06-13 18:00:31 +08:00
loss.py [feat] Support DAPO (#6263) 2025-04-25 17:39:17 +08:00
producer.py add profiling, implement memory efficient logprob alculation 2025-06-18 10:08:22 +00:00
README.md
utils.py add profiling, implement memory efficient logprob alculation 2025-06-18 10:08:22 +00:00

README.md

Requirements

pip install cupy-cuda12x
python -m cupyx.tools.install_library --cuda 12.x --library nccl