mirror of
https://github.com/hwchase17/langchain.git
synced 2026-04-04 03:14:33 +00:00
aff771923a
Use docusaurus versioning with a callout, merged master as well @hwchase17 @baskaryan --------- Signed-off-by: Weichen Xu <weichen.xu@databricks.com> Signed-off-by: Rahul Tripathi <rauhl.psit.ec@gmail.com> Co-authored-by: Leonid Ganeline <leo.gan.57@gmail.com> Co-authored-by: Leonid Kuligin <lkuligin@yandex.ru> Co-authored-by: Averi Kitsch <akitsch@google.com> Co-authored-by: Erick Friis <erick@langchain.dev> Co-authored-by: Nuno Campos <nuno@langchain.dev> Co-authored-by: Nuno Campos <nuno@boringbits.io> Co-authored-by: Bagatur <22008038+baskaryan@users.noreply.github.com> Co-authored-by: Eugene Yurtsev <eyurtsev@gmail.com> Co-authored-by: Martín Gotelli Ferenaz <martingotelliferenaz@gmail.com> Co-authored-by: Fayfox <admin@fayfox.com> Co-authored-by: Eugene Yurtsev <eugene@langchain.dev> Co-authored-by: Dawson Bauer <105886620+djbauer2@users.noreply.github.com> Co-authored-by: Ravindu Somawansa <ravindu.somawansa@gmail.com> Co-authored-by: Dhruv Chawla <43818888+Dominastorm@users.noreply.github.com> Co-authored-by: ccurme <chester.curme@gmail.com> Co-authored-by: Bagatur <baskaryan@gmail.com> Co-authored-by: WeichenXu <weichen.xu@databricks.com> Co-authored-by: Benito Geordie <89472452+benitoThree@users.noreply.github.com> Co-authored-by: kartikTAI <129414343+kartikTAI@users.noreply.github.com> Co-authored-by: Kartik Sarangmath <kartik@thirdai.com> Co-authored-by: Sevin F. Varoglu <sfvaroglu@octoml.ai> Co-authored-by: MacanPN <martin.triska@gmail.com> Co-authored-by: Prashanth Rao <35005448+prrao87@users.noreply.github.com> Co-authored-by: Hyeongchan Kim <kozistr@gmail.com> Co-authored-by: sdan <git@sdan.io> Co-authored-by: Guangdong Liu <liugddx@gmail.com> Co-authored-by: Rahul Triptahi <rahul.psit.ec@gmail.com> Co-authored-by: Rahul Tripathi <rauhl.psit.ec@gmail.com> Co-authored-by: pjb157 <84070455+pjb157@users.noreply.github.com> Co-authored-by: Eun Hye Kim <ehkim1440@gmail.com> Co-authored-by: kaijietti <43436010+kaijietti@users.noreply.github.com> Co-authored-by: Pengcheng Liu <pcliu.fd@gmail.com> Co-authored-by: Tomer Cagan <tomer@tomercagan.com> Co-authored-by: Christophe Bornet <cbornet@hotmail.com>
54 lines
1.7 KiB
Plaintext
54 lines
1.7 KiB
Plaintext
# DeepInfra
|
|
|
|
>[DeepInfra](https://deepinfra.com/docs) allows us to run the
|
|
> [latest machine learning models](https://deepinfra.com/models) with ease.
|
|
> DeepInfra takes care of all the heavy lifting related to running, scaling and monitoring
|
|
> the models. Users can focus on your application and integrate the models with simple REST API calls.
|
|
|
|
>DeepInfra provides [examples](https://deepinfra.com/docs/advanced/langchain) of integration with LangChain.
|
|
|
|
This page covers how to use the `DeepInfra` ecosystem within `LangChain`.
|
|
It is broken into two parts: installation and setup, and then references to specific DeepInfra wrappers.
|
|
|
|
## Installation and Setup
|
|
|
|
- Get your DeepInfra api key from this link [here](https://deepinfra.com/).
|
|
- Get an DeepInfra api key and set it as an environment variable (`DEEPINFRA_API_TOKEN`)
|
|
|
|
## Available Models
|
|
|
|
DeepInfra provides a range of Open Source LLMs ready for deployment.
|
|
|
|
You can see supported models for
|
|
[text-generation](https://deepinfra.com/models?type=text-generation) and
|
|
[embeddings](https://deepinfra.com/models?type=embeddings).
|
|
|
|
You can view a [list of request and response parameters](https://deepinfra.com/meta-llama/Llama-2-70b-chat-hf/api).
|
|
|
|
Chat models [follow openai api](https://deepinfra.com/meta-llama/Llama-2-70b-chat-hf/api?example=openai-http)
|
|
|
|
|
|
## LLM
|
|
|
|
See a [usage example](/docs/integrations/llms/deepinfra).
|
|
|
|
```python
|
|
from langchain_community.llms import DeepInfra
|
|
```
|
|
|
|
## Embeddings
|
|
|
|
See a [usage example](/docs/integrations/text_embedding/deepinfra).
|
|
|
|
```python
|
|
from langchain_community.embeddings import DeepInfraEmbeddings
|
|
```
|
|
|
|
## Chat Models
|
|
|
|
See a [usage example](/docs/integrations/chat/deepinfra).
|
|
|
|
```python
|
|
from langchain_community.chat_models import ChatDeepInfra
|
|
```
|