HELSON dbdc9a7783 added Multiply Jitter and capacity factor eval for MOE (#434)

2022-03-16 16:47:44 +08:00

..

colossalai_layer

moved env variables to global variables; (#215)

2022-02-15 11:31:13 +08:00

moe

added Multiply Jitter and capacity factor eval for MOE (#434)

2022-03-16 16:47:44 +08:00

parallel_1d

fix format (#376)

2022-03-11 15:50:28 +08:00

parallel_2d

fixed padding index issue for vocab parallel embedding layers; updated 3D linear to be compatible with examples in the tutorial

2022-03-11 15:50:28 +08:00

parallel_2p5d

fix format parallel_2p5d (#357)

2022-03-11 15:50:28 +08:00

parallel_3d

fix format for dir-[parallel_3d] (#333)

2022-03-11 15:50:28 +08:00

parallel_sequence

adapted for sequence parallel (#163)

2022-01-20 13:44:51 +08:00

utils

Added activation offload (#331)

2022-03-11 15:50:28 +08:00

vanilla

flake8 style (#352)

2022-03-11 15:50:28 +08:00

wrapper

flake8 style (#352)

2022-03-11 15:50:28 +08:00

__init__.py

Hotfix/Colossalai layers (#92)

2021-12-29 23:32:10 +08:00

base_layer.py

Migrated project

2021-10-28 18:21:23 +02:00