github/privateGPT
1
0
Fork 1
mirror of https://github.com/imartinez/privateGPT.git synced 2025-08-30 13:29:20 +00:00
Code Issues Packages Projects Releases Wiki Activity

Bump vllm to 0.5.1

Browse Source
This commit is contained in:
Yevhenii Semendiak 2024-07-08 17:50:28 +03:00
parent df7deefdb4
commit 4b33f54d8a
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
.neuro/live.yaml
View File

@ -69,7 +69,7 @@ jobs:
VLLM_TOKENIZER: meta-llama/Meta-Llama-3-8B-Instruct VLLM_TOKENIZER: meta-llama/Meta-Llama-3-8B-Instruct
vllm: vllm:
image: vllm/vllm-openai:v0.4.0 image: vllm/vllm-openai:v0.5.1
name: vllm name: vllm
preset: H100x1 preset: H100x1
detach: true detach: true