duanjunwen e1ca2d22ae [ColossalRL] Support ColossalRL on Ascend (#6324) ...

* [fix] support npu

* [feat] multinode 14B

* [feat] enlarge seqlen

* [fix]

* [fix] ready to updated

* [fix] ready to merge grpo-latest

* [fix] rm comments

* [feat] support msprof-analyze, add analsys result

* [feat] support ColossalaiRL on Ascend

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [feat] rm comments in qwen modeling

* [Doc] Drafted README.md

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [feat] fix ascend readme format

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [fix] fix readme

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [fix] fix readme

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [fix] fix Readme, rm irrelevant testcase

* [fix] fix some adapt modification

* [fix] rm comments in modeling qwen

* [fix] rm comm, test and debug print

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: YeAnbang <44796419+YeAnbang@users.noreply.github.com>

2025-05-28 10:43:13 +08:00

..

chatglm2_6b

[pre-commit.ci] pre-commit autoupdate (#5572)

2024-07-01 17:16:41 +08:00

__init__.py

[shardformer] added development protocol for standardization (#4149)

2023-07-04 16:05:01 +08:00

bert.py

[fp8] support hybrid parallel plugin (#5982)

2024-08-12 18:17:05 +08:00

blip2.py

[shardformer] support bias_gelu_jit_fused for models (#5647)

2024-04-29 15:33:51 +08:00

bloom.py

[Feature] Split cross-entropy computation in SP (#5959)

2024-09-10 12:06:50 +08:00

chatglm2.py

[Device]Support npu (#6159)

2024-12-17 15:42:39 +08:00

command.py

[Feature] Split cross-entropy computation in SP (#5959)

2024-09-10 12:06:50 +08:00

deepseek_v3.py

[shardformer] support pipeline for deepseek v3 and optimize lora save (#6188)

2025-02-14 14:48:54 +08:00

deepseek.py

[moe] add parallel strategy for shared_expert && fix test for deepseek (#6063)

2024-09-18 10:09:01 +08:00

falcon.py

[shardformer] fix modeling of bloom and falcon (#5796)

2024-06-11 17:43:50 +08:00

gpt2.py

fix

2024-10-15 13:28:33 +08:00

gptj.py

[fp8] support hybrid parallel plugin (#5982)

2024-08-12 18:17:05 +08:00

jit.py

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

llama.py

[Zerobubble] merge main. (#6142)

2024-11-19 19:00:36 +08:00

mistral.py

[Feature] Split cross-entropy computation in SP (#5959)

2024-09-10 12:06:50 +08:00

mixtral.py

[Zerobubble] merge main. (#6142)

2024-11-19 19:00:36 +08:00

opt.py

[Feature] Split cross-entropy computation in SP (#5959)

2024-09-10 12:06:50 +08:00

qwen2.py

[ColossalRL] Support ColossalRL on Ascend (#6324)

2025-05-28 10:43:13 +08:00

sam.py

[shardformer]delete xformers (#5859)

2024-06-28 11:20:04 +08:00

t5.py

[shardformer] Support the T5ForTokenClassification model (#5816)

2024-06-27 16:40:38 +08:00

vit.py

[shardformer] support bias_gelu_jit_fused for models (#5647)

2024-04-29 15:33:51 +08:00

whisper.py

[shardformer] upgrade transformers to 4.39.3 (#5815)

2024-06-14 10:59:33 +08:00