mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-07-16 17:16:14 +00:00

Files

YeAnbang 50153005b4 [feat] add microbatch forwarding (#6251 )

* add microbatch forwarding

* fix forward microbatch

* fix producer OOM

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* change project name

* fix temperature annealing

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* address conversation

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

2025-03-28 10:24:58 +08:00

reward

fix reward score

2025-03-11 10:17:32 +08:00

__init__.py

[chat] add distributed impl (#6210 )

2025-02-21 15:24:23 +08:00

comm.py

[chat] add distributed impl (#6210 )

2025-02-21 15:24:23 +08:00

consumer.py

[feat] add microbatch forwarding (#6251 )

2025-03-28 10:24:58 +08:00

grpo_consumer.py

[feat] add microbatch forwarding (#6251 )

2025-03-28 10:24:58 +08:00

inference_backend.py

simplify vllm preprocessing input ids

2025-03-21 15:03:10 +08:00

launch.py

[feat] add microbatch forwarding (#6251 )

2025-03-28 10:24:58 +08:00

loss.py

fix vllm

2025-03-19 17:11:10 +08:00

producer.py

[feat] add microbatch forwarding (#6251 )

2025-03-28 10:24:58 +08:00

README.md

[chat] add distributed impl (#6210 )

2025-02-21 15:24:23 +08:00

utils.py

[Feature] Support Distributed LogProb for GRPO Training (#6247 )

2025-03-18 17:47:55 +08:00

README.md

Requirements

pip install cupy-cuda12x
python -m cupyx.tools.install_library --cuda 12.x --library nccl