mirror of
https://github.com/hpcaitech/ColossalAI.git
synced 2025-09-17 23:18:36 +00:00
[shardformer] support pipeline base vit model (#4284)
* Feature/vit support (#4182) * [shardformer] added tests * [shardformer] vit test finish and support * fix attention dropout * support base vit pipeline * support vit downstream model * fix vit shard test * modify hidden states return type --------- Co-authored-by: Kun Lin <81014421+klhhhhh@users.noreply.github.com>
This commit is contained in:
@@ -5,3 +5,4 @@ from .gpt import *
|
||||
from .llama import *
|
||||
from .opt import *
|
||||
from .t5 import *
|
||||
from .vit import *
|
||||
|
Reference in New Issue
Block a user