アマデウス 9ee197d0e9 moved env variables to global variables; (#215) ...

added branch context;
added vocab parallel layers;
moved split_batch from load_batch to tensor parallel embedding layers;
updated gpt model;
updated unit test cases;
fixed few collective communicator bugs

2022-02-15 11:31:13 +08:00

..

colossalai_layer

moved env variables to global variables; (#215)

2022-02-15 11:31:13 +08:00

moe

Fixed docstring in colossalai (#171)

2022-01-21 10:44:30 +08:00

parallel_1d

moved env variables to global variables; (#215)

2022-02-15 11:31:13 +08:00

parallel_2d

moved env variables to global variables; (#215)

2022-02-15 11:31:13 +08:00

parallel_2p5d

moved env variables to global variables; (#215)

2022-02-15 11:31:13 +08:00

parallel_3d

moved env variables to global variables; (#215)

2022-02-15 11:31:13 +08:00

parallel_sequence

adapted for sequence parallel (#163)

2022-01-20 13:44:51 +08:00

utils

moved env variables to global variables; (#215)

2022-02-15 11:31:13 +08:00

vanilla

moved env variables to global variables; (#215)

2022-02-15 11:31:13 +08:00

wrapper

Fixed docstring in colossalai (#171)

2022-01-21 10:44:30 +08:00

__init__.py

Hotfix/Colossalai layers (#92)

2021-12-29 23:32:10 +08:00

base_layer.py

Migrated project

2021-10-28 18:21:23 +02:00