ColossalAI/tests
Hongxin Liu df63564184
[gemini] support amp o3 for gemini (#4872)
* [gemini] support no reuse fp16 chunk

* [gemini] support no master weight for optim

* [gemini] support no master weight for gemini ddp

* [test] update gemini tests

* [test] update gemini tests

* [plugin] update gemini plugin

* [test] fix gemini checkpointio test

* [test] fix gemini checkpoint io
2023-10-12 10:39:08 +08:00
..
components_to_test [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
kit [test] modify model supporting part of low_level_zero plugin (including correspoding docs) 2023-10-05 15:10:31 +08:00
test_analyzer [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_auto_parallel [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_autochunk [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_booster [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_checkpoint_io [gemini] support amp o3 for gemini (#4872) 2023-10-12 10:39:08 +08:00
test_cluster [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_config [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_device [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_fx [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_gptq [feature] add gptq for inference (#4754) 2023-09-22 11:02:50 +08:00
test_infer fix test llama (#4884) 2023-10-11 17:43:01 +08:00
test_infer_ops [infer] fix test bug (#4838) 2023-10-04 10:01:03 +08:00
test_lazy [lazy] support from_pretrained (#4801) 2023-09-26 11:04:11 +08:00
test_legacy [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_moe [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_optimizer [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_pipeline [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_shardformer [hotfix] fix bug in sequence parallel test (#4887) 2023-10-11 19:30:41 +08:00
test_tensor [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_utils [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
test_zero [gemini] support amp o3 for gemini (#4872) 2023-10-12 10:39:08 +08:00
__init__.py [zero] Update sharded model v2 using sharded param v2 (#323) 2022-03-11 15:50:28 +08:00