mirror of
https://github.com/hwchase17/langchain.git
synced 2025-05-14 03:27:29 +00:00
126 lines
3.3 KiB
Plaintext
126 lines
3.3 KiB
Plaintext
{
|
|
"cells": [
|
|
{
|
|
"cell_type": "markdown",
|
|
"id": "2970dd75-8ebf-4b51-8282-9b454b8f356d",
|
|
"metadata": {},
|
|
"source": [
|
|
"# Together AI\n",
|
|
"\n",
|
|
":::caution\n",
|
|
"You are currently on a page documenting the use of Together AI models as [text completion models](/docs/concepts/#llms). Many popular Together AI models are [chat completion models](/docs/concepts/#chat-models).\n",
|
|
"\n",
|
|
"You may be looking for [this page instead](/docs/integrations/chat/together/).\n",
|
|
":::\n",
|
|
"\n",
|
|
"[Together AI](https://www.together.ai/) offers an API to query [50+ leading open-source models](https://docs.together.ai/docs/inference-models) in a couple lines of code.\n",
|
|
"\n",
|
|
"This example goes over how to use LangChain to interact with Together AI models."
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "markdown",
|
|
"id": "1c47fc36",
|
|
"metadata": {},
|
|
"source": [
|
|
"## Installation"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "code",
|
|
"execution_count": null,
|
|
"id": "1ecdb29d",
|
|
"metadata": {},
|
|
"outputs": [],
|
|
"source": [
|
|
"%pip install --upgrade langchain-together"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "markdown",
|
|
"id": "89883202",
|
|
"metadata": {},
|
|
"source": [
|
|
"## Environment\n",
|
|
"\n",
|
|
"To use Together AI, you'll need an API key which you can find here:\n",
|
|
"https://api.together.ai/settings/api-keys. This can be passed in as an init param\n",
|
|
"``together_api_key`` or set as environment variable ``TOGETHER_API_KEY``.\n"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "markdown",
|
|
"id": "8304b4d9",
|
|
"metadata": {},
|
|
"source": [
|
|
"## Example"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "code",
|
|
"execution_count": null,
|
|
"id": "637bb53f",
|
|
"metadata": {},
|
|
"outputs": [],
|
|
"source": [
|
|
"# Querying chat models with Together AI\n",
|
|
"\n",
|
|
"from langchain_together import ChatTogether\n",
|
|
"\n",
|
|
"# choose from our 50+ models here: https://docs.together.ai/docs/inference-models\n",
|
|
"chat = ChatTogether(\n",
|
|
" # together_api_key=\"YOUR_API_KEY\",\n",
|
|
" model=\"meta-llama/Llama-3-70b-chat-hf\",\n",
|
|
")\n",
|
|
"\n",
|
|
"# stream the response back from the model\n",
|
|
"for m in chat.stream(\"Tell me fun things to do in NYC\"):\n",
|
|
" print(m.content, end=\"\", flush=True)\n",
|
|
"\n",
|
|
"# if you don't want to do streaming, you can use the invoke method\n",
|
|
"# chat.invoke(\"Tell me fun things to do in NYC\")"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "code",
|
|
"execution_count": null,
|
|
"id": "e7b7170d-d7c5-4890-9714-a37238343805",
|
|
"metadata": {},
|
|
"outputs": [],
|
|
"source": [
|
|
"# Querying code and language models with Together AI\n",
|
|
"\n",
|
|
"from langchain_together import Together\n",
|
|
"\n",
|
|
"llm = Together(\n",
|
|
" model=\"codellama/CodeLlama-70b-Python-hf\",\n",
|
|
" # together_api_key=\"...\"\n",
|
|
")\n",
|
|
"\n",
|
|
"print(llm.invoke(\"def bubble_sort(): \"))"
|
|
]
|
|
}
|
|
],
|
|
"metadata": {
|
|
"kernelspec": {
|
|
"display_name": ".venv",
|
|
"language": "python",
|
|
"name": "python3"
|
|
},
|
|
"language_info": {
|
|
"codemirror_mode": {
|
|
"name": "ipython",
|
|
"version": 3
|
|
},
|
|
"file_extension": ".py",
|
|
"mimetype": "text/x-python",
|
|
"name": "python",
|
|
"nbconvert_exporter": "python",
|
|
"pygments_lexer": "ipython3",
|
|
"version": "3.11.4"
|
|
}
|
|
},
|
|
"nbformat": 4,
|
|
"nbformat_minor": 5
|
|
}
|