github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-04-29 04:05:35 +00:00
Code Issues Packages Projects Releases Wiki Activity
refactor/inference
ColossalAI/tests/test_infer
History
Yuanheng Zhao 916459c99a
[inference] Add model forward accuracy test (#5102) 
* [inference] add model forward accuracy test

* trivial: modify params

* trivial: remove print message
2023-11-27 14:14:06 +08:00
..
_utils.py [hotfix] Suport extra_kwargs in ShardConfig (#5031) 2023-11-10 10:49:50 +08:00
test_hybrid_bloom.py [inference] update examples and engine (#5073) 2023-11-20 19:44:52 +08:00
test_hybrid_chatglm2.py [inference] update examples and engine (#5073) 2023-11-20 19:44:52 +08:00
test_hybrid_llama.py [inference] update examples and engine (#5073) 2023-11-20 19:44:52 +08:00
test_kvcache_manager.py [inference] Refactor inference architecture (#5057) 2023-11-19 21:05:05 +08:00
test_model_accuracy.py [inference] Add model forward accuracy test (#5102) 2023-11-27 14:14:06 +08:00