アマデウス 0fedef4f3c Layer integration (#83) ...

* integrated parallel layers for ease of building models

* integrated 2.5d layers

* cleaned codes and unit tests

* added log metric by step hook; updated imagenet benchmark; fixed some bugs

* reworked initialization; cleaned codes

Co-authored-by: BoxiangW <45734921+BoxiangW@users.noreply.github.com>

2021-12-27 15:04:32 +08:00

..

amp

add interleaved pipeline, fix naive amp and update pipeline model initializer (#80)

2021-12-20 23:26:19 +08:00

builder

add interleaved pipeline, fix naive amp and update pipeline model initializer (#80)

2021-12-20 23:26:19 +08:00

communication

Layer integration (#83)

2021-12-27 15:04:32 +08:00

context

Layer integration (#83)

2021-12-27 15:04:32 +08:00

engine

add interleaved pipeline, fix naive amp and update pipeline model initializer (#80)

2021-12-20 23:26:19 +08:00

kernel

add colossalai kernel module (#55)

2021-12-21 12:19:52 +08:00

logging

update examples and sphnix docs for the new api (#63)

2021-12-13 22:07:01 +08:00

nn

Layer integration (#83)

2021-12-27 15:04:32 +08:00

registry

Develop/experiments (#59)

2021-12-09 15:08:29 +08:00

trainer

Layer integration (#83)

2021-12-27 15:04:32 +08:00

utils

Layer integration (#83)

2021-12-27 15:04:32 +08:00

zero

fixed zero level 3 dtype bug (#76)

2021-12-20 17:00:53 +08:00

__init__.py

Develop/experiments (#59)

2021-12-09 15:08:29 +08:00

constants.py

Develop/experiments (#59)

2021-12-09 15:08:29 +08:00

core.py

Develop/experiments (#59)

2021-12-09 15:08:29 +08:00

initialize.py

Layer integration (#83)

2021-12-27 15:04:32 +08:00