github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-08-05 01:59:57 +00:00
Code Issues Packages Projects Releases Wiki Activity
dev/zero-offload
ColossalAI/tests/test_infer
History
Zhongkai Zhao 75af66cd81
[Hotfix] Fix model policy matching strategy in ShardFormer (#5064) 
* hotfix/Fix get model policy strategy in ShardFormer

* fix bug in auto policy
2023-11-22 11:19:39 +08:00
..
_utils.py [Hotfix] Fix model policy matching strategy in ShardFormer (#5064) 2023-11-22 11:19:39 +08:00
test_hybrid_bloom.py [inference] update examples and engine (#5073) 2023-11-20 19:44:52 +08:00
test_hybrid_chatglm2.py [inference] update examples and engine (#5073) 2023-11-20 19:44:52 +08:00
test_hybrid_llama.py [inference] update examples and engine (#5073) 2023-11-20 19:44:52 +08:00
test_kvcache_manager.py [inference] Refactor inference architecture (#5057) 2023-11-19 21:05:05 +08:00