github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-05-01 21:26:42 +00:00
Code Issues Packages Projects Releases Wiki Activity
ckpt
ColossalAI/tests
History
Hongxin Liu dc2cdaf3e8
[shardformer] optimize seq parallelism () 
* [shardformer] optimize seq parallelism

* [shardformer] fix gpt2 fused linear col

* [plugin] update gemini plugin

* [plugin] update moe hybrid plugin

* [test] update gpt2 fused linear test

* [shardformer] fix gpt2 fused linear reduce
2024-10-11 13:44:40 +08:00
..
kit [Feature] Split cross-entropy computation in SP () 2024-09-10 12:06:50 +08:00
test_analyzer [misc] update pre-commit and run all files () 2023-09-19 14:20:26 +08:00
test_auto_parallel [test] Fix/fix testcase () 2024-06-03 15:26:01 +08:00
test_autochunk [misc] update pre-commit and run all files () 2023-09-19 14:20:26 +08:00
test_booster [fp8] Merge feature/fp8_comm to main branch of Colossalai () 2024-08-22 09:21:34 +08:00
test_checkpoint_io [fp8] Merge feature/fp8_comm to main branch of Colossalai () 2024-08-22 09:21:34 +08:00
test_cluster [misc] refactor launch API and tensor constructor () 2024-04-29 10:40:11 +08:00
test_config [misc] update pre-commit and run all files () 2023-09-19 14:20:26 +08:00
test_device [misc] refactor launch API and tensor constructor () 2024-04-29 10:40:11 +08:00
test_fp8 [fp8] Disable all_gather intranode. Disable Redundant all_gather fp8 () 2024-09-14 10:40:01 +08:00
test_fx [hotfix] fix testcase in test_fx/test_tracer () 2024-06-05 11:29:32 +08:00
test_infer [release] update version () 2024-09-10 10:31:09 +08:00
test_lazy [fp8] Merge feature/fp8_comm to main branch of Colossalai () 2024-08-22 09:21:34 +08:00
test_legacy [FP8] rebase main () 2024-08-06 16:29:37 +08:00
test_lora [fp8] Merge feature/fp8_comm to main branch of Colossalai () 2024-08-22 09:21:34 +08:00
test_moe [hotfix] moe hybrid parallelism benchmark & follow-up fix () 2024-09-10 17:30:53 +08:00
test_optimizer [MoE/ZeRO] Moe refactor with zero refactor () 2024-06-28 14:00:08 +08:00
test_pipeline [fp8] Merge feature/fp8_comm to main branch of Colossalai () 2024-08-22 09:21:34 +08:00
test_shardformer [shardformer] optimize seq parallelism () 2024-10-11 13:44:40 +08:00
test_smoothquant [inference] Add smmoothquant for llama () 2023-10-16 11:28:44 +08:00
test_tensor [misc] refactor launch API and tensor constructor () 2024-04-29 10:40:11 +08:00
test_zero [FP8] rebase main () 2024-08-06 16:29:37 +08:00
__init__.py