アマデウス 9ee197d0e9 moved env variables to global variables; (#215) ...

added branch context;
added vocab parallel layers;
moved split_batch from load_batch to tensor parallel embedding layers;
updated gpt model;
updated unit test cases;
fixed few collective communicator bugs

2022-02-15 11:31:13 +08:00

..

bert

Develop/experiments (#59)

2021-12-09 15:08:29 +08:00

gpt

moved env variables to global variables; (#215)

2022-02-15 11:31:13 +08:00

mlp_mixer

Develop/experiments (#59)

2021-12-09 15:08:29 +08:00

moe

Added moe parallel example (#140)

2022-01-17 15:34:04 +08:00

vit

added gpt model & benchmark (#95)

2021-12-30 14:43:30 +08:00

__init__.py

Develop/experiments (#59)

2021-12-09 15:08:29 +08:00

helper.py

Added MoE parallel (#127)

2022-01-07 15:08:36 +08:00