FangYin Cheng d8a4b776d5 feat: Support 8-bit quantization and 4-bit quantization for multi-gpu inference

2023-08-02 19:29:59 +08:00

..

allinone

feat: supports docker compose deployment

2023-07-26 20:07:25 +08:00

base

feat: Support 8-bit quantization and 4-bit quantization for multi-gpu inference

2023-08-02 19:29:59 +08:00

examples

feat: supports docker compose deployment

2023-07-26 20:07:25 +08:00

build_all_images.sh

feat: Support 8-bit quantization and 4-bit quantization for multi-gpu inference

2023-08-02 19:29:59 +08:00