github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-09-07 20:10:17 +00:00
Code Issues Packages Projects Releases Wiki Activity

add moe context, moe utilities and refactor gradient handler (#455)

Browse Source
This commit is contained in:
HELSON
2022-03-18 16:38:32 +08:00
committed by GitHub
parent af185b5519
commit 84fd7c1d4d
11 changed files with 255 additions and 125 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
colossalai/context/__init__.py
View File

@@ -1,5 +1,6 @@
from .config import Config, ConfigException
from .parallel_context import ParallelContext
from .moe_context import MoeContext
from .parallel_mode import ParallelMode
from .process_group_initializer import *
from .random import *