github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-09-30 14:06:04 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
3c0d82b19b8814c2e39d1d25d6de9dd25d25c21e
ColossalAI/examples/inference
History
Hongxin Liu 1cd7efc520 [inference] refactor examples and fix schedule (#5077) 
* [setup] refactor infer setup

* [hotfix] fix infenrece behavior on 1 1 gpu

* [exmaple] refactor inference examples
2023-11-21 10:46:03 +08:00
..
benchmark_llama.py
[inference] refactor examples and fix schedule (#5077)
2023-11-21 10:46:03 +08:00
build_smoothquant_weight.py
[inference] refactor examples and fix schedule (#5077)
2023-11-21 10:46:03 +08:00
run_benchmark.sh
[inference] refactor examples and fix schedule (#5077)
2023-11-21 10:46:03 +08:00
run_llama_inference.py
[inference] refactor examples and fix schedule (#5077)
2023-11-21 10:46:03 +08:00