github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-06-01 20:05:27 +00:00
Code Issues Packages Projects Releases Wiki Activity
4e3959d316
ColossalAI/examples/inference
History
Bin Jia 4e3959d316
[hotfix/hybridengine] Fix init model with random parameters in benchmark (#5074) 
* fix init model with random parameters

* fix example
2023-11-20 20:15:25 +08:00
..
_utils.py [Inference]ADD Bench Chatglm2 script (#4963) 2023-10-24 13:11:15 +08:00
benchmark.py [hotfix/hybridengine] Fix init model with random parameters in benchmark (#5074) 2023-11-20 20:15:25 +08:00
build_smoothquant_weight.py [inference] update examples and engine (#5073) 2023-11-20 19:44:52 +08:00
run_benchmark.sh [hotfix/hybridengine] Fix init model with random parameters in benchmark (#5074) 2023-11-20 20:15:25 +08:00
run_llama_inference.py [inference] update examples and engine (#5073) 2023-11-20 19:44:52 +08:00