github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-04-25 09:12:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
2a73e828eba565017d19eaf70a304e1b1eddba1f
ColossalAI/examples/inference
History
Hongxin Liu 1cd7efc520 [inference] refactor examples and fix schedule (#5077) 
* [setup] refactor infer setup

* [hotfix] fix infenrece behavior on 1 1 gpu

* [exmaple] refactor inference examples
2023-11-21 10:46:03 +08:00
..
benchmark_llama.py
[inference] refactor examples and fix schedule (#5077)
2023-11-21 10:46:03 +08:00
build_smoothquant_weight.py
[inference] refactor examples and fix schedule (#5077)
2023-11-21 10:46:03 +08:00
run_benchmark.sh
[inference] refactor examples and fix schedule (#5077)
2023-11-21 10:46:03 +08:00
run_llama_inference.py
[inference] refactor examples and fix schedule (#5077)
2023-11-21 10:46:03 +08:00