HELSON aff9d354f7 [MOE] polish moe_env (#467)

2022-03-19 15:36:25 +08:00

..

colossalai_layer

moved env variables to global variables; (#215)

2022-02-15 11:31:13 +08:00

moe

[MOE] polish moe_env (#467)

2022-03-19 15:36:25 +08:00

parallel_1d

fix format (#376)

2022-03-11 15:50:28 +08:00

parallel_2d

fixed padding index issue for vocab parallel embedding layers; updated 3D linear to be compatible with examples in the tutorial

2022-03-11 15:50:28 +08:00

parallel_2p5d

fix format parallel_2p5d (#357)

2022-03-11 15:50:28 +08:00

parallel_3d

fix format for dir-[parallel_3d] (#333)

2022-03-11 15:50:28 +08:00

parallel_sequence

adapted for sequence parallel (#163)

2022-01-20 13:44:51 +08:00

utils

Added activation offload (#331)

2022-03-11 15:50:28 +08:00

vanilla

flake8 style (#352)

2022-03-11 15:50:28 +08:00

wrapper

flake8 style (#352)

2022-03-11 15:50:28 +08:00

__init__.py

[MOE] changed parallelmode to dist process group (#460)

2022-03-19 13:46:29 +08:00

base_layer.py

Migrated project

2021-10-28 18:21:23 +02:00