1SAA 219df6e685 Optimized MoE layer and fixed some bugs; ...

Decreased moe tests;

Added FFNExperts and ViTMoE model

2022-03-11 15:50:28 +08:00

..

csrc

Optimized MoE layer and fixed some bugs;

2022-03-11 15:50:28 +08:00

__init__.py

refactor kernel (#142)

2022-01-13 16:47:17 +08:00

layer_norm.py

moved env variables to global variables; (#215)

2022-02-15 11:31:13 +08:00

multihead_attention.py

Fixed docstring in colossalai (#171)

2022-01-21 10:44:30 +08:00

scaled_softmax.py

Fixed docstring in colossalai (#171)

2022-01-21 10:44:30 +08:00