mirror of
https://github.com/hwchase17/langchain.git
synced 2026-03-18 02:53:16 +00:00
initial commit
replicate readme add replicate to integration simple replicate test rename api key to token, and update to latest python client update replicate docs
This commit is contained in:
49
docs/ecosystem/replicate.md
Normal file
49
docs/ecosystem/replicate.md
Normal file
@@ -0,0 +1,49 @@
|
||||
# Replicate
|
||||
This page covers how to use the Replicate ecosystem within LangChain.
|
||||
|
||||
## Installation and Setup
|
||||
- Create a [Replicate](https://replicate.com) account. Get your api key and set it as an environment variable (`REPLICATE_API_TOKEN`)
|
||||
- Install the [Replicate python client](https://github.com/replicate/replicate-python) with `pip install replicate`
|
||||
|
||||
## Calling a model
|
||||
|
||||
Find a model on the [replicate explore page](https://replicate.com/explore), and then paste in the model name and version in this format: model_name/version
|
||||
|
||||
For example, for this [flan-t5 model]( https://replicate.com/daanelson/flan-t5), click on the API tab. The model name/version would be: `daanelson/flan-t5:04e422a9b85baed86a4f24981d7f9953e20c5fd82f6103b74ebc431588e1cec8`
|
||||
|
||||
Only the `model` param is required, but we can add other model params when initializing.
|
||||
|
||||
For example, if we were running stable diffusion and wanted to change the image dimensions:
|
||||
|
||||
```
|
||||
Replicate(model="stability-ai/stable-diffusion:db21e45d3f7023abc2a46ee38a23973f6dce16bb082a930b0c49861f96d1e5bf",
|
||||
image_dimensions='512x512')
|
||||
```
|
||||
|
||||
*Note that only the first output of a model will be returned.*
|
||||
|
||||
From here, we can initialize our model:
|
||||
|
||||
```python
|
||||
llm = Replicate(model="daanelson/flan-t5:04e422a9b85baed86a4f24981d7f9953e20c5fd82f6103b74ebc431588e1cec8")
|
||||
```
|
||||
|
||||
And run it:
|
||||
|
||||
```python
|
||||
prompt = """
|
||||
Answer the following yes/no question by reasoning step by step.
|
||||
Can a dog drive a car?
|
||||
"""
|
||||
llm(prompt)
|
||||
```
|
||||
|
||||
We can call any replicate model (not just LLMs) using this syntax. For example, we can call stable diffusion:
|
||||
|
||||
```python
|
||||
text2image = Replicate(model="stability-ai/stable-diffusion:db21e45d3f7023abc2a46ee38a23973f6dce16bb082a930b0c49861f96d1e5bf",
|
||||
image_dimensions='512x512'
|
||||
|
||||
image_output = text2image("A cat riding a motorcycle by Picasso")
|
||||
image_output
|
||||
```
|
||||
@@ -39,6 +39,8 @@ The examples here are all "how-to" guides for how to integrate with various LLM
|
||||
|
||||
`Self-Hosted Models (via Runhouse) <./integrations/self_hosted_examples.html>`_: Covers how to run models on existing or on-demand remote compute with LangChain.
|
||||
|
||||
`Replicate <./integrations/replicate_example.html>`_: Covers how to utilize the Replicate wrapper.
|
||||
|
||||
|
||||
.. toctree::
|
||||
:maxdepth: 1
|
||||
|
||||
374
docs/modules/llms/integrations/replicate.ipynb
Normal file
374
docs/modules/llms/integrations/replicate.ipynb
Normal file
File diff suppressed because one or more lines are too long
Reference in New Issue
Block a user