langchain/docs/extras
Massimiliano Pronesti d95eeaedbe
feat(llms): support vLLM's OpenAI-compatible server (#9179)
This PR aims at supporting [vLLM's OpenAI-compatible server
feature](https://vllm.readthedocs.io/en/latest/getting_started/quickstart.html#openai-compatible-server),
i.e. allowing to call vLLM's LLMs like if they were OpenAI's.

I've also udpated the related notebook providing an example usage. At
the moment, vLLM only supports the `Completion` API.
2023-08-13 23:03:05 -07:00
..
_templates Update Integrations links (#8206) 2023-07-24 21:20:32 -07:00
additional_resources Link to use cases from tutorials (#8371) 2023-07-27 11:54:04 -07:00
ecosystem use top nav docs (#8090) 2023-07-21 13:52:03 -07:00
guides multiple retreival in parralel (#9174) 2023-08-13 10:03:54 -07:00
integrations feat(llms): support vLLM's OpenAI-compatible server (#9179) 2023-08-13 23:03:05 -07:00
modules RedisStore: Update init and Documentation updates (#9044) 2023-08-10 15:30:29 -04:00
use_cases multiple retreival in parralel (#9174) 2023-08-13 10:03:54 -07:00