github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-09-09 04:50:17 +00:00
Code Issues Packages Projects Releases Wiki Activity

[booster] implement Gemini plugin (#3352)

Browse Source 
* [booster] add gemini plugin

* [booster] update docstr

* [booster] gemini plugin add coloparam convertor

* [booster] fix coloparam convertor

* [booster] fix gemini plugin device

* [booster] add gemini plugin test

* [booster] gemini plugin ignore sync bn

* [booster] skip some model

* [booster] skip some model

* [booster] modify test world size

* [booster] modify test world size

* [booster] skip test
This commit is contained in:
ver217
2023-03-31 16:06:13 +08:00
committed by GitHub
parent 1a1d68b053
commit 5f2e34e6c9
3 changed files with 490 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
colossalai/booster/plugin/__init__.py
View File

@@ -1,4 +1,5 @@
from .gemini_plugin import GeminiPlugin
from .plugin_base import Plugin
from .torch_ddp_plugin import TorchDDPPlugin
__all__ = ['Plugin', 'TorchDDPPlugin']
__all__ = ['Plugin', 'TorchDDPPlugin', 'GeminiPlugin']