cefe277a35
replicate readme add replicate to integration simple replicate test rename api key to token, and update to latest python client update replicate docs
1.8 KiB
Replicate
This page covers how to use the Replicate ecosystem within LangChain.
Installation and Setup
- Create a Replicate account. Get your api key and set it as an environment variable (
REPLICATE_API_TOKEN) - Install the Replicate python client with
pip install replicate
Calling a model
Find a model on the replicate explore page, and then paste in the model name and version in this format: model_name/version
For example, for this flan-t5 model, click on the API tab. The model name/version would be: daanelson/flan-t5:04e422a9b85baed86a4f24981d7f9953e20c5fd82f6103b74ebc431588e1cec8
Only the model param is required, but we can add other model params when initializing.
For example, if we were running stable diffusion and wanted to change the image dimensions:
Replicate(model="stability-ai/stable-diffusion:db21e45d3f7023abc2a46ee38a23973f6dce16bb082a930b0c49861f96d1e5bf",
image_dimensions='512x512')
Note that only the first output of a model will be returned.
From here, we can initialize our model:
llm = Replicate(model="daanelson/flan-t5:04e422a9b85baed86a4f24981d7f9953e20c5fd82f6103b74ebc431588e1cec8")
And run it:
prompt = """
Answer the following yes/no question by reasoning step by step.
Can a dog drive a car?
"""
llm(prompt)
We can call any replicate model (not just LLMs) using this syntax. For example, we can call stable diffusion:
text2image = Replicate(model="stability-ai/stable-diffusion:db21e45d3f7023abc2a46ee38a23973f6dce16bb082a930b0c49861f96d1e5bf",
image_dimensions='512x512'
image_output = text2image("A cat riding a motorcycle by Picasso")
image_output