github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-05-02 08:37:36 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
b0b53a171c4bcf26c259c508373e13d213adbf71
ColossalAI/examples/inference
History
Hongxin Liu 1cd7efc520 [inference] refactor examples and fix schedule (#5077) 
* [setup] refactor infer setup

* [hotfix] fix infenrece behavior on 1 1 gpu

* [exmaple] refactor inference examples
2023-11-21 10:46:03 +08:00
..
benchmark_llama.py
[inference] refactor examples and fix schedule (#5077)
2023-11-21 10:46:03 +08:00
build_smoothquant_weight.py
[inference] refactor examples and fix schedule (#5077)
2023-11-21 10:46:03 +08:00
run_benchmark.sh
[inference] refactor examples and fix schedule (#5077)
2023-11-21 10:46:03 +08:00
run_llama_inference.py
[inference] refactor examples and fix schedule (#5077)
2023-11-21 10:46:03 +08:00