ColossalAI/tests/kit/model_zoo/transformers/__init__.py
Hongxin Liu 2b415e5999
[shardformer] support ep for deepseek v3 (#6185)
* [feature] support ep for deepseek v3

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix test

* [shardformer] fix deepseek v3 init

* [lazy] fit lora for lazy init

* [example] support npu for deepseek v3

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2025-02-11 16:10:25 +08:00

21 lines
429 B
Python

from .albert import *
from .bert import *
from .blip2 import *
from .bloom import *
from .chatglm2 import *
from .command import *
from .deepseek import *
from .deepseek_v3 import *
from .falcon import *
from .gpt import *
from .gptj import *
from .llama import *
from .mistral import *
from .mixtral import *
from .opt import *
from .qwen2 import *
from .sam import *
from .t5 import *
from .vit import *
from .whisper import *