ver217 0aab577f19 [zero] update sharded optim v2 (#334)

2022-03-09 16:09:36 +08:00

..

components_to_test

fix bert unit test

2022-03-09 14:49:55 +08:00

test_comm

Hotfix/Colossalai layers (#92)

2021-12-29 23:32:10 +08:00

test_config

[profiler] primary memory tracer

2022-03-04 09:35:23 +08:00

test_context

Optimize pipeline schedule (#94)

2021-12-30 15:56:46 +08:00

test_data

added CI for unit testing (#69)

2021-12-16 10:32:08 +08:00

test_data_pipeline_tensor_parallel

Optimize pipeline schedule (#94)

2021-12-30 15:56:46 +08:00

test_engine

skip bert in test engine

2022-03-09 14:49:55 +08:00

test_layers

fixed padding index issue for vocab parallel embedding layers; updated 3D linear to be compatible with examples in the tutorial

2022-02-22 02:05:43 +00:00

test_moe

Added TPExpert for special situation

2022-02-28 13:55:35 +08:00

test_optimizer

[zero] cpu adam kernel (#288)

2022-03-04 16:05:15 +08:00

test_profiler

Added profiler communication operations

2022-03-07 15:17:06 +08:00

test_trainer

pipeline last stage supports multi output (#151)

2022-01-17 15:57:47 +08:00

test_utils

Feature/zero (#279)

2022-03-01 18:17:01 +08:00

test_zero_data_parallel

[zero] update sharded optim v2 (#334)

2022-03-09 16:09:36 +08:00

test_zero_tensor_parallel

Feature/zero (#279)

2022-03-01 18:17:01 +08:00

__init__.py

[zero] Update sharded model v2 using sharded param v2 (#323)

2022-03-08 18:18:06 +08:00