github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-04-29 04:05:35 +00:00
Code Issues Packages Projects Releases Wiki Activity
c174c4fc5f
ColossalAI/examples/inference
History
Hongxin Liu 1cd7efc520
[inference] refactor examples and fix schedule (#5077) 
* [setup] refactor infer setup

* [hotfix] fix infenrece behavior on 1 1 gpu

* [exmaple] refactor inference examples
2023-11-21 10:46:03 +08:00
..
benchmark_llama.py [inference] refactor examples and fix schedule (#5077) 2023-11-21 10:46:03 +08:00
build_smoothquant_weight.py [inference] refactor examples and fix schedule (#5077) 2023-11-21 10:46:03 +08:00
run_benchmark.sh [inference] refactor examples and fix schedule (#5077) 2023-11-21 10:46:03 +08:00
run_llama_inference.py [inference] refactor examples and fix schedule (#5077) 2023-11-21 10:46:03 +08:00