ver217 9ef05ed1fc try import deepspeed when using zero (#130)

2022-01-07 17:24:57 +08:00

..

amp

Optimize pipeline schedule (#94)

2021-12-30 15:56:46 +08:00

builder

Optimize pipeline schedule (#94)

2021-12-30 15:56:46 +08:00

communication

add scatter/gather optim for pipeline (#123)

2022-01-07 13:22:22 +08:00

context

Added MoE parallel (#127)

2022-01-07 15:08:36 +08:00

engine

Added MoE parallel (#127)

2022-01-07 15:08:36 +08:00

kernel

add colossalai kernel module (#55)

2021-12-21 12:19:52 +08:00

logging

update default logger (#100) (#101)

2022-01-04 20:03:26 +08:00

nn

Added MoE parallel (#127)

2022-01-07 15:08:36 +08:00

registry

Develop/experiments (#59)

2021-12-09 15:08:29 +08:00

trainer

fix a bug in timer (#114)

2022-01-05 16:07:06 +08:00

utils

Added MoE parallel (#127)

2022-01-07 15:08:36 +08:00

zero

try import deepspeed when using zero (#130)

2022-01-07 17:24:57 +08:00

__init__.py

Develop/experiments (#59)

2021-12-09 15:08:29 +08:00

constants.py

Added MoE parallel (#127)

2022-01-07 15:08:36 +08:00

core.py

Develop/experiments (#59)

2021-12-09 15:08:29 +08:00

global_variables.py

Added MoE parallel (#127)

2022-01-07 15:08:36 +08:00

initialize.py

Added MoE parallel (#127)

2022-01-07 15:08:36 +08:00