flybird11111
eaef783ec3
fix
2025-04-10 10:19:38 +08:00
flybird11111
99298c6a6d
Merge branch 'upgrade-transformers' of github.com:flybird11111/ColossalAI into upgrade-transformers
2025-04-09 18:25:56 +08:00
flybird11111
25c5e420f2
fix
2025-04-09 18:24:33 +08:00
pre-commit-ci[bot]
dce221283d
[pre-commit.ci] auto fixes from pre-commit.com hooks
...
for more information, see https://pre-commit.ci
2025-04-09 09:57:35 +00:00
flybird11111
603e2296c7
fix
2025-04-09 17:56:07 +08:00
flybird11111
d5a3d1a44e
fix
2025-04-09 17:29:58 +08:00
flybird11111
0e900ac5cd
fix
2025-04-09 17:29:08 +08:00
pre-commit-ci[bot]
57d7b16a18
[pre-commit.ci] auto fixes from pre-commit.com hooks
...
for more information, see https://pre-commit.ci
2025-04-09 08:34:31 +00:00
flybird11111
e92a692c97
Merge branch 'upgrade-transformers' of github.com:flybird11111/ColossalAI into upgrade-transformers
2025-04-09 16:33:16 +08:00
flybird11111
a4e5ed9990
fix
2025-04-09 16:32:10 +08:00
pre-commit-ci[bot]
466b61e674
[pre-commit.ci] auto fixes from pre-commit.com hooks
...
for more information, see https://pre-commit.ci
2025-04-09 07:53:51 +00:00
flybird11111
c0811d7342
fix
2025-04-09 15:52:42 +08:00
pre-commit-ci[bot]
b38d45ee51
[pre-commit.ci] auto fixes from pre-commit.com hooks
...
for more information, see https://pre-commit.ci
2025-04-09 07:23:04 +00:00
flybird11111
28cf1e2c57
fix
2025-04-09 15:20:14 +08:00
flybird11111
397875e640
Update build_on_pr.yml
2025-04-09 15:14:17 +08:00
flybird11111
ca914147eb
Update test_fp16_torch.py
2025-04-09 14:01:47 +08:00
pre-commit-ci[bot]
3491a9f7e3
[pre-commit.ci] auto fixes from pre-commit.com hooks
...
for more information, see https://pre-commit.ci
2025-04-01 07:34:49 +00:00
flybird11111
4b8b67ae23
fix
2025-04-01 15:32:11 +08:00
pre-commit-ci[bot]
822556a8ca
[pre-commit.ci] auto fixes from pre-commit.com hooks
...
for more information, see https://pre-commit.ci
2025-03-31 08:17:17 +00:00
flybird11111
621cb93bb1
fix
2025-03-31 16:16:15 +08:00
flybird11111
8c66b7c3e9
fix
2025-03-31 15:39:37 +08:00
flybird11111
837a503f50
fix
2025-03-31 15:32:51 +08:00
flybird11111
43885a4317
fix
2025-03-31 15:17:30 +08:00
flybird11111
6c728df3e3
fix
2025-03-31 11:22:59 +08:00
flybird11111
0b81be7f7f
add ci machine
2025-03-28 18:04:03 +08:00
flybird11111
40cf89d66e
Merge branch 'hpcaitech:main' into upgrade-transformers
2025-03-27 18:11:39 +08:00
flybird11111
3ecb5000e3
test for upgrading transformers
2025-03-27 18:08:37 +08:00
duanjunwen
44d4053fec
[HotFix] update load lora model Readme; ( #6240 )
...
* [fix] update load lora model Readme;
* [fix] update lora infer readme
* [fix] remove useless comments
2025-03-07 14:14:26 +08:00
Hongxin Liu
6d676ee0e9
[release] update version ( #6236 )
2025-03-03 16:15:09 +08:00
Hongxin Liu
56fe130b15
[hotfix] fix lora load ( #6231 )
...
* [hotfix] fix lora load
* [hotfix] fix hp load
* accelerate deepseek loading
2025-03-01 19:04:14 +08:00
Hongxin Liu
f32861ccc5
[misc] update torch version ( #6206 )
...
* [misc] update torch version
* fix test
* fix test
* fix test
* fix test
2025-02-24 14:35:48 +08:00
YeAnbang
b9e60559b8
Merge pull request #6208 from hpcaitech/grpo_dev
...
[Chat] fix colossalchat bugs
2025-02-20 21:23:16 +08:00
pre-commit-ci[bot]
7595c453a5
[pre-commit.ci] auto fixes from pre-commit.com hooks
...
for more information, see https://pre-commit.ci
2025-02-20 10:25:19 +00:00
YeAnbang
53834b74b9
fix num_train_step update
2025-02-20 18:24:04 +08:00
YeAnbang
0171884664
fix inference rebatching bug
2025-02-20 17:28:49 +08:00
Hongxin Liu
9379cbd668
[release] update version ( #6195 )
...
* [release] update version
* fix test
* fix test
2025-02-20 11:36:18 +08:00
binmakeswell
24dee8f0b7
[doc] DeepSeek V3/R1 news ( #6199 )
...
* [doc] DeepSeek V3/R1 news
* [doc] DeepSeek V3/R1 news
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
---------
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2025-02-19 15:07:29 +08:00
Hongxin Liu
f73ae55394
[application] add lora sft example data ( #6198 )
2025-02-18 20:18:18 +08:00
Tong Li
f8b9e88484
[application] Update README ( #6196 )
...
* remove unused ray
* remove unused readme
* update readme
* update readme
* update
* update
* add link
* update readme
* update readme
* fix link
* update code
* update cititaion
* update
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update readme
* update project
* add images
* update link
* update note
---------
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2025-02-18 20:17:56 +08:00
Hongxin Liu
d54642a263
[application] add lora sft example ( #6192 )
...
* [application] add lora sft example
* update requirements
* update readme
* update comment
* update ci
2025-02-18 13:06:38 +08:00
YeAnbang
d20c8ffd97
Add GRPO and Support RLVR for PPO ( #6186 )
...
* add grpo, support rlvr
* add grpo, support rlvr
* tested deepseek r1 pipeline
* add ci
* verify grpo r1
* verify grpo r1
* update readme, remove unused code
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* remove path
* clean code
* fix circular import
* fix ci OOM
* fix ci OOM
* skip kto tp, fix qwen generation
---------
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2025-02-18 09:43:36 +08:00
flybird11111
ce0ec40811
[checkpointio] fix for async io ( #6189 )
2025-02-14 17:34:13 +08:00
flybird11111
510ff7bec2
Merge branch 'hpcaitech:main' into main
2025-02-14 15:24:15 +08:00
Hongxin Liu
5ff5323538
[hotfix] fix zero optim save ( #6191 )
2025-02-14 15:09:50 +08:00
Hongxin Liu
014837e725
[shardformer] support pipeline for deepseek v3 and optimize lora save ( #6188 )
...
* [shardformer] support pipeline for deepseek v3
* [checkpointio] fix lora save
* [devops] update ci env
* [booster] optimize lora
* fix test
* fix test
2025-02-14 14:48:54 +08:00
flybird11111
6fc6a059a0
fix for async io
2025-02-13 14:06:57 +08:00
Wenxuan Tan
ec73f1b5e2
[CI] Cleanup Dist Optim tests with shared helper funcs ( #6125 )
...
* Refractor and cleanup using common helper funcs. Tests passed
* Update comments
* Fix relative import
* Fix param fetching bug
2025-02-12 13:42:34 +08:00
flybird11111
5c09d726a6
[checkpointio] fix checkpoint for 3d ( #6187 )
...
* fix checkpoint io for 3d
* fix
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Update hybrid_parallel_checkpoint_io.py
* fix
---------
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2025-02-12 11:54:55 +08:00
Hongxin Liu
2b415e5999
[shardformer] support ep for deepseek v3 ( #6185 )
...
* [feature] support ep for deepseek v3
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* fix test
* [shardformer] fix deepseek v3 init
* [lazy] fit lora for lazy init
* [example] support npu for deepseek v3
---------
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2025-02-11 16:10:25 +08:00
flybird11111
17062c83b9
[hotfix] fix hybrid checkpointio for sp+dp ( #6184 )
...
* Update hybrid_parallel_plugin.py
* Update hybrid_parallel_plugin.py
* Update hybrid_parallel_plugin.py
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Update build_on_pr.yml
* Update test_zerobubble_pp.py
* fix
* fix
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* fix
---------
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2025-02-06 17:21:04 +08:00
