Yuanheng Zhao 3a74eb4b3a [Infer] Colossal-Inference serving example w/ TorchServe (single GPU case) (#4771) ...

* add Colossal-Inference serving example w/ TorchServe

* add dockerfile

* fix dockerfile

* fix dockerfile: fix commit hash, install curl

* refactor file structure

* revise readme

* trivial

* trivial: dockerfile format

* clean dir; revise readme

* fix comments: fix imports and configs

* fix formats

* remove unused requirements

2023-10-02 17:42:37 +08:00

..

serving

[Infer] Colossal-Inference serving example w/ TorchServe (single GPU case) (#4771)

2023-10-02 17:42:37 +08:00

bench_bloom.py

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

bench_llama.py

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

gptq_bloom.py

[feature] add gptq for inference (#4754)

2023-09-22 11:02:50 +08:00

gptq_llama.py

[feature] add gptq for inference (#4754)

2023-09-22 11:02:50 +08:00