github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-08-27 20:22:09 +00:00
Code Issues Packages Projects Releases Wiki Activity

merge grpo-latest

Browse Source
This commit is contained in:
YeAnbang 2025-04-16 10:03:19 +08:00
commit 24c01864df
1 changed files with 2 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
applications/ColossalChat/rl_example.py
View File

@ -144,7 +144,8 @@ if __name__ == "__main__":
grpo_config=grpo_config, grpo_config=grpo_config,
plugin_config={ plugin_config={
"zero_stage": 2, "zero_stage": 2,
}, # for zero },
# for zero
# plugin_config={ # plugin_config={
# "pp_size": 2, # "pp_size": 2,
# "tp_size": 2, # "tp_size": 2,