shenggan 5c3843dc98 add colossalai kernel module (#55)

2021-12-21 12:19:52 +08:00

..

amp

add interleaved pipeline, fix naive amp and update pipeline model initializer (#80)

2021-12-20 23:26:19 +08:00

builder

add interleaved pipeline, fix naive amp and update pipeline model initializer (#80)

2021-12-20 23:26:19 +08:00

communication

add interleaved pipeline, fix naive amp and update pipeline model initializer (#80)

2021-12-20 23:26:19 +08:00

context

add interleaved pipeline, fix naive amp and update pipeline model initializer (#80)

2021-12-20 23:26:19 +08:00

engine

add interleaved pipeline, fix naive amp and update pipeline model initializer (#80)

2021-12-20 23:26:19 +08:00

kernel

add colossalai kernel module (#55)

2021-12-21 12:19:52 +08:00

logging

update examples and sphnix docs for the new api (#63)

2021-12-13 22:07:01 +08:00

nn

overlap computation and communication in 2d operations (#75)

2021-12-16 16:05:15 +08:00

registry

Develop/experiments (#59)

2021-12-09 15:08:29 +08:00

trainer

added CI for unit testing (#69)

2021-12-16 10:32:08 +08:00

utils

add interleaved pipeline, fix naive amp and update pipeline model initializer (#80)

2021-12-20 23:26:19 +08:00

zero

fixed zero level 3 dtype bug (#76)

2021-12-20 17:00:53 +08:00

__init__.py

Develop/experiments (#59)

2021-12-09 15:08:29 +08:00

constants.py

Develop/experiments (#59)

2021-12-09 15:08:29 +08:00

core.py

Develop/experiments (#59)

2021-12-09 15:08:29 +08:00

initialize.py

add interleaved pipeline, fix naive amp and update pipeline model initializer (#80)

2021-12-20 23:26:19 +08:00