5 Commits

Author	SHA1	Message	Date
johannesploetner	c951a5b1d3	Update gpt4all-api/gpt4all_api/app/api_v1/routes/chat.py ... Co-authored-by: Jared Van Bortel <cebtenzzre@gmail.com> Signed-off-by: johannesploetner <52075191+johannesploetner@users.noreply.github.com>	2024-03-11 09:58:47 -05:00
Johannes Plötner	026ee4e46b	Implement /v1/chat/completions endpoint for CPU mode ... Signed-off-by: Johannes Plötner <johannes.w.m.ploetner@gmail.com>	2024-03-11 09:58:47 -05:00
dsalvatierra	76413e1d03	Refactor engines module to fetch engine details ... from API Update chat.py Signed-off-by: Daniel Salvatierra <dsalvat1@gmail.com>	2023-11-21 10:46:51 -05:00
Zach Nussbaum	8aba2c9009	GPU Inference Server (#1112) ... * feat: local inference server * fix: source to use bash + vars * chore: isort and black * fix: make file + inference mode * chore: logging * refactor: remove old links * fix: add new env vars * feat: hf inference server * refactor: remove old links * test: batch and single response * chore: black + isort * separate gpu and cpu dockerfiles * moved gpu to separate dockerfile * Fixed test endpoints * Edits to API. server won't start due to failed instantiation error * Method signature * fix: gpu_infer * tests: fix tests --------- Co-authored-by: Andriy Mulyar <andriy.mulyar@gmail.com>	2023-07-21 15:13:29 -04:00
Andriy Mulyar	633e2a2137	GPT4All API Scaffolding. Matches OpenAI OpenAPI spec for chats and completions (#839) ... * GPT4All API Scaffolding. Matches OpenAI OpenAI spec for engines, chats and completions * Edits for docker building * FastAPI app builds and pydantic models are accurate * Added groovy download into dockerfile * improved dockerfile * Chat completions endpoint edits * API uni test sketch * Working example of groovy inference with open ai api * Added lines to test * Set default to mpt	2023-06-28 14:28:52 -04:00