github/privateGPT
1
0
Fork 1
mirror of https://github.com/imartinez/privateGPT.git synced 2025-06-24 14:33:23 +00:00
Code Issues Packages Projects Releases Wiki Activity

Fix 503 when private gpt gets ollama service

Browse Source 
When running private gpt with external ollama API, ollama service
returns 503 on startup because ollama service (traefik) might not be
ready.

- Add healthcheck to ollama service to test for connection to external
ollama
- private-gpt-ollama service depends on ollama being service_healthy
This commit is contained in:
Koh Meng Hui 2024-10-16 20:24:11 +08:00
parent 5851b02378
commit aeace47057
1 changed files with 8 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

9
docker-compose.yaml
View File

@ -29,7 +29,8 @@ services:
- ollama-cuda - ollama-cuda
- ollama-api - ollama-api
depends_on: depends_on:
- ollama ollama:
condition: service_healthy
# Private-GPT service for the local mode # Private-GPT service for the local mode
# This service builds from a local Dockerfile and runs the application in local mode. # This service builds from a local Dockerfile and runs the application in local mode.
@ -60,6 +61,12 @@ services:
# This will route requests to the Ollama service based on the profile. # This will route requests to the Ollama service based on the profile.
ollama: ollama:
image: traefik:v2.10 image: traefik:v2.10
healthcheck:
test: ["CMD", "sh", "-c", "wget -q --spider http://ollama:11434 || exit 1"]
interval: 10s
retries: 3
start_period: 5s
timeout: 5s
ports: ports:
- "8080:8080" - "8080:8080"
command: command: