botbw 4fa6b9509c [moe] add parallel strategy for shared_expert && fix test for deepseek (#6063)

2024-09-18 10:09:01 +08:00

..

chatglm2_6b

[pre-commit.ci] pre-commit autoupdate (#5572)

2024-07-01 17:16:41 +08:00

__init__.py

[shardformer] added development protocol for standardization (#4149)

2023-07-04 16:05:01 +08:00

bert.py

[fp8] support hybrid parallel plugin (#5982)

2024-08-12 18:17:05 +08:00

blip2.py

[shardformer] support bias_gelu_jit_fused for models (#5647)

2024-04-29 15:33:51 +08:00

bloom.py

[Feature] Split cross-entropy computation in SP (#5959)

2024-09-10 12:06:50 +08:00

chatglm2.py

[Feature] Split cross-entropy computation in SP (#5959)

2024-09-10 12:06:50 +08:00

command.py

[Feature] Split cross-entropy computation in SP (#5959)

2024-09-10 12:06:50 +08:00

deepseek.py

[moe] add parallel strategy for shared_expert && fix test for deepseek (#6063)

2024-09-18 10:09:01 +08:00

falcon.py

[shardformer] fix modeling of bloom and falcon (#5796)

2024-06-11 17:43:50 +08:00

gpt2.py

[Feature] Split cross-entropy computation in SP (#5959)

2024-09-10 12:06:50 +08:00

gptj.py

[fp8] support hybrid parallel plugin (#5982)

2024-08-12 18:17:05 +08:00

jit.py

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

llama.py

[Feature] Split cross-entropy computation in SP (#5959)

2024-09-10 12:06:50 +08:00

mistral.py

[Feature] Split cross-entropy computation in SP (#5959)

2024-09-10 12:06:50 +08:00

mixtral.py

[fp8] fix missing fp8_comm flag in mixtral (#6057)

2024-09-13 14:30:05 +08:00

opt.py

[Feature] Split cross-entropy computation in SP (#5959)

2024-09-10 12:06:50 +08:00

qwen2.py

[Feature] Split cross-entropy computation in SP (#5959)

2024-09-10 12:06:50 +08:00

sam.py

[shardformer]delete xformers (#5859)

2024-06-28 11:20:04 +08:00

t5.py

[shardformer] Support the T5ForTokenClassification model (#5816)

2024-06-27 16:40:38 +08:00

vit.py

[shardformer] support bias_gelu_jit_fused for models (#5647)

2024-04-29 15:33:51 +08:00

whisper.py

[shardformer] upgrade transformers to 4.39.3 (#5815)

2024-06-14 10:59:33 +08:00