FangYin Cheng 1303d4c5e5 fix(model): Fix load some quantization model error

2023-10-15 17:40:56 +08:00

..

cache

feat: Optimize code import time

2023-09-01 10:40:18 +08:00

cluster

feat(core): Read and save system information to tracer

2023-10-13 16:23:14 +08:00

llm

feat(model): Support vLLM

2023-10-09 20:02:11 +08:00

llm_out

feat(model): Support vLLM

2023-10-09 20:02:11 +08:00

proxy

fix(model): Fix openai adapt previous proxy_server_url configuration and support azure openai model

2023-10-12 20:06:54 +08:00

__init__.py

update

2023-04-28 22:48:39 +08:00

adapter.py

feat(core): Support cross-service data recording

2023-10-12 01:18:48 +08:00

base.py

feat(core): Support cross-service data recording

2023-10-12 01:18:48 +08:00

cli.py

feat(model): Support vLLM

2023-10-09 20:02:11 +08:00

compression.py

ci: make ci happy lint the code, delete unused imports

2023-05-24 18:43:04 +08:00

conversation.py

feat(model): Support vLLM

2023-10-09 20:02:11 +08:00

inference.py

feat(model): Support vLLM

2023-10-09 20:02:11 +08:00

llm_utils.py

feat(model): Support vLLM

2023-10-09 20:02:11 +08:00

loader.py

feat(model): Support vLLM

2023-10-09 20:02:11 +08:00

model_adapter.py

fix(model): Fix load some quantization model error

2023-10-15 17:40:56 +08:00

parameter.py

fix(model): Fix openai adapt previous proxy_server_url configuration and support azure openai model

2023-10-12 20:06:54 +08:00