Wang Binluo 868afdb311 Dev/zero offload (#5858) ...

* fix llama

* fix llama

2024-06-26 16:07:06 +08:00

..

chatglm2_6b

[hotfix] fix typo change enabel to enable under colossalai/shardformer/ (#5317)

2024-03-05 21:48:46 +08:00

__init__.py

[shardformer] added development protocol for standardization (#4149)

2023-07-04 16:05:01 +08:00

bert.py

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

blip2.py

[shardformer] update colo attention to support custom mask (#5510)

2024-03-27 11:19:32 +08:00

bloom.py

[hotfix] fix typo change enabel to enable under colossalai/shardformer/ (#5317)

2024-03-05 21:48:46 +08:00

chatglm2.py

[shardformer] update colo attention to support custom mask (#5510)

2024-03-27 11:19:32 +08:00

falcon.py

[shardformer]: support gpt-j, falcon, Mistral and add interleaved pipeline for bert (#5088)

2023-11-28 16:54:42 +08:00

gpt2.py

[format] applied code formatting on changed files in pull request 5510 (#5517)

2024-03-27 11:21:03 +08:00

gptj.py

[shardformer] update colo attention to support custom mask (#5510)

2024-03-27 11:19:32 +08:00

jit.py

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

llama.py

Dev/zero offload (#5858)

2024-06-26 16:07:06 +08:00

mistral.py

[feat] refactored extension module (#5298)

2024-01-25 17:01:48 +08:00

opt.py

[shardformer] update colo attention to support custom mask (#5510)

2024-03-27 11:19:32 +08:00

qwen2.py

update qwen model

2024-06-20 09:04:57 +00:00

sam.py

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

t5.py

[hotfix] fix typo change enabel to enable under colossalai/shardformer/ (#5317)

2024-03-05 21:48:46 +08:00

vit.py

[shardformer] update colo attention to support custom mask (#5510)

2024-03-27 11:19:32 +08:00

whisper.py

[shardformer] update colo attention to support custom mask (#5510)

2024-03-27 11:19:32 +08:00