FangYin Cheng d8a4b776d5 feat: Support 8-bit quantization and 4-bit quantization for multi-gpu inference

2023-08-02 19:29:59 +08:00

..

build_image.sh

feat: Support 8-bit quantization and 4-bit quantization for multi-gpu inference

2023-08-02 19:29:59 +08:00

Dockerfile

feat: Support 8-bit quantization and 4-bit quantization for multi-gpu inference

2023-08-02 19:29:59 +08:00