Jiarui Fang 7ef3507ace [zero] show model data cuda memory usage after zero context init. (#515)

2022-03-25 11:23:35 +08:00

..

components_to_test

[zero] new interface for ShardedOptimv2 (#406)

2022-03-14 20:48:41 +08:00

test_amp

[polish] polish singleton and global context (#500)

2022-03-23 18:03:39 +08:00

test_comm

…

test_config

…

test_context

optimized context test time consumption (#446)

2022-03-17 14:40:52 +08:00

test_data

…

test_data_pipeline_tensor_parallel

optimize engine and trainer test (#448)

2022-03-17 15:44:17 +08:00

test_engine

optimize engine and trainer test (#448)

2022-03-17 15:44:17 +08:00

test_layers

…

test_moe

[polish] polish singleton and global context (#500)

2022-03-23 18:03:39 +08:00

test_optimizer

[hotfix] run cpu adam unittest in pytest (#424)

2022-03-16 10:39:55 +08:00

test_trainer

optimize engine and trainer test (#448)

2022-03-17 15:44:17 +08:00

test_utils

[zero] show model data cuda memory usage after zero context init. (#515)

2022-03-25 11:23:35 +08:00

test_zero_data_parallel

[zero] sharded model support the reuse of fp16 shard (#495)

2022-03-23 14:59:59 +08:00

test_zero_tensor_parallel

…

__init__.py

[zero] Update sharded model v2 using sharded param v2 (#323)

2022-03-11 15:50:28 +08:00