github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-09-01 09:07:51 +00:00
Code Issues Packages Projects Releases Wiki Activity

[test] modify model supporting part of low_level_zero plugin (including correspoding docs)

Browse Source
This commit is contained in:
Zhongkai Zhao
2023-10-05 15:10:31 +08:00
parent d1fcc0fa4d
commit db40e086c8
3 changed files with 0 additions and 22 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
docs/source/en/basics/booster_plugins.md
View File

@@ -44,12 +44,6 @@ We've tested compatibility on some famous models, following models may not be su
- `timm.models.convit_base`
- dlrm and deepfm models in `torchrec`
- `diffusers.VQModel`
- `transformers.AlbertModel`
- `transformers.AlbertForPreTraining`
- `transformers.BertModel`
- `transformers.BertForPreTraining`
- `transformers.GPT2DoubleHeadsModel`
Compatibility problems will be fixed in the future.

6
docs/source/zh-Hans/basics/booster_plugins.md
View File

@@ -42,12 +42,6 @@ Zero-2 不支持局部梯度累积。如果您坚持使用，虽然可以积累
- `timm.models.convit_base`
- dlrm and deepfm models in `torchrec`
- `diffusers.VQModel`
- `transformers.AlbertModel`
- `transformers.AlbertForPreTraining`
- `transformers.BertModel`
- `transformers.BertForPreTraining`
- `transformers.GPT2DoubleHeadsModel`
兼容性问题将在未来修复。