ColossalAI/colossalai/nn/layer at a45ddf2d5f21cd24b5f9e79ef2cbf30dc57fa10a - ColossalAI - Gitea: Git with a cup of tea at home

github/ColossalAI

mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-01-19 17:16:39 +00:00

Files

History

Frank Lee 2b2dc1c86b [pipeline] refactor the pipeline module (#1087 )

* [pipeline] refactor the pipeline module

* polish code

2022-06-10 11:27:38 +08:00

..

colossalai_layer

[TP] allow layernorm without bias (#750 )

2022-04-14 11:43:56 +08:00

[gemini] add GeminiMemoryManger (#832 )

2022-04-24 13:08:48 +08:00

[Tensor] 1d row embedding (#1075 )

2022-06-08 12:04:59 +08:00

[NFC] polish colossalai/nn/layer/parallel_2d/layers.py code style (#976 )

2022-05-17 10:25:06 +08:00

[NFC] polish colossalai/nn/layer/parallel_2p5d/layers.py code style (#972 )

2022-05-17 10:25:06 +08:00

[NFC] polish colossalai/nn/layer/parallel_3d/layers.py code style (#966 )

2022-05-17 10:25:06 +08:00

parallel_sequence

Refactored docstring to google style

2022-03-29 17:17:47 +08:00

[NFC] polish colossalai/nn/layer/utils/common.py code style (#983 )

2022-05-17 10:25:06 +08:00

[TP] allow layernorm without bias (#750 )

2022-04-14 11:43:56 +08:00

[pipeline] refactor the pipeline module (#1087 )

2022-06-10 11:27:38 +08:00

__init__.py

[MOE] changed parallelmode to dist process group (#460 )

2022-03-19 13:46:29 +08:00

base_layer.py

[model checkpoint] reworked unified layers for ease of save/load states (#593 )

2022-04-01 16:49:56 +08:00