Commit Graph

3 Commits

Author SHA1 Message Date
FangYin Cheng
a4574aa614 feat: Support vicuna-v1.5 and WizardLM-v1.2 2023-08-03 14:14:29 +08:00
FangYin Cheng
d8a4b776d5 feat: Support 8-bit quantization and 4-bit quantization for multi-gpu inference 2023-08-02 19:29:59 +08:00
FangYin Cheng
671cddf4e7 feat: supports docker compose deployment 2023-07-26 20:07:25 +08:00