github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-01-16 07:28:45 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
cf579ff46dc8d6e4c8f9b311134b693c2aeb0adc
ColossalAI/examples/inference
History
Jianghai c6cd629e7a [Inference]ADD Bench Chatglm2 script (#4963) 
* add bench chatglm

* fix bug and make utils

---------

Co-authored-by: CjhHa1 <cjh18671720497outlook.com>
2023-10-24 13:11:15 +08:00
..
serving
[Infer] Serving example w/ ray-serve (multiple GPU case) (#4841)
2023-10-02 17:48:38 +08:00
_utils.py
[Inference]ADD Bench Chatglm2 script (#4963)
2023-10-24 13:11:15 +08:00
bench_bloom.py
[Inference]ADD Bench Chatglm2 script (#4963)
2023-10-24 13:11:15 +08:00
bench_chatglm2.py
[Inference]ADD Bench Chatglm2 script (#4963)
2023-10-24 13:11:15 +08:00
bench_llama.py
[Inference]ADD Bench Chatglm2 script (#4963)
2023-10-24 13:11:15 +08:00
gptq_bloom.py
[Inference]ADD Bench Chatglm2 script (#4963)
2023-10-24 13:11:15 +08:00
gptq_llama.py
[Inference]ADD Bench Chatglm2 script (#4963)
2023-10-24 13:11:15 +08:00
smoothquant_llama.py
[inference] Add smmoothquant for llama (#4904)
2023-10-16 11:28:44 +08:00