mirror of
https://github.com/hwchase17/langchain.git
synced 2026-02-21 14:43:07 +00:00
466 lines
15 KiB
Plaintext
466 lines
15 KiB
Plaintext
{
|
||
"cells": [
|
||
{
|
||
"cell_type": "raw",
|
||
"metadata": {},
|
||
"source": [
|
||
"---\n",
|
||
"sidebar_position: 3\n",
|
||
"---"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "markdown",
|
||
"metadata": {},
|
||
"source": [
|
||
"# How to add tools to chatbots\n",
|
||
"\n",
|
||
"This section will cover how to create conversational agents: chatbots that can interact with other systems and APIs using tools.\n",
|
||
"\n",
|
||
"Before reading this guide, we recommend you read both [the chatbot quickstart](/docs/tutorials/chatbot) in this section and be familiar with [the documentation on agents](/docs/tutorials/agents).\n",
|
||
"\n",
|
||
"## Setup\n",
|
||
"\n",
|
||
"For this guide, we'll be using an [OpenAI tools agent](/docs/how_to/agent_executor) with a single tool for searching the web. The default will be powered by [Tavily](/docs/integrations/tools/tavily_search), but you can switch it out for any similar tool. The rest of this section will assume you're using Tavily.\n",
|
||
"\n",
|
||
"You'll need to [sign up for an account](https://tavily.com/) on the Tavily website, and install the following packages:"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "code",
|
||
"execution_count": 1,
|
||
"metadata": {},
|
||
"outputs": [
|
||
{
|
||
"name": "stdout",
|
||
"output_type": "stream",
|
||
"text": [
|
||
"\u001b[33mWARNING: You are using pip version 22.0.4; however, version 23.3.2 is available.\n",
|
||
"You should consider upgrading via the '/Users/jacoblee/.pyenv/versions/3.10.5/bin/python -m pip install --upgrade pip' command.\u001b[0m\u001b[33m\n",
|
||
"\u001b[0mNote: you may need to restart the kernel to use updated packages.\n"
|
||
]
|
||
},
|
||
{
|
||
"data": {
|
||
"text/plain": [
|
||
"True"
|
||
]
|
||
},
|
||
"execution_count": 1,
|
||
"metadata": {},
|
||
"output_type": "execute_result"
|
||
}
|
||
],
|
||
"source": [
|
||
"%pip install --upgrade --quiet langchain-openai tavily-python\n",
|
||
"\n",
|
||
"# Set env var OPENAI_API_KEY or load from a .env file:\n",
|
||
"import dotenv\n",
|
||
"\n",
|
||
"dotenv.load_dotenv()"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "markdown",
|
||
"metadata": {},
|
||
"source": [
|
||
"You will also need your OpenAI key set as `OPENAI_API_KEY` and your Tavily API key set as `TAVILY_API_KEY`."
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "markdown",
|
||
"metadata": {},
|
||
"source": [
|
||
"## Creating an agent\n",
|
||
"\n",
|
||
"Our end goal is to create an agent that can respond conversationally to user questions while looking up information as needed.\n",
|
||
"\n",
|
||
"First, let's initialize Tavily and an OpenAI chat model capable of tool calling:"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "code",
|
||
"execution_count": 2,
|
||
"metadata": {},
|
||
"outputs": [],
|
||
"source": [
|
||
"from langchain_community.tools.tavily_search import TavilySearchResults\n",
|
||
"from langchain_openai import ChatOpenAI\n",
|
||
"\n",
|
||
"tools = [TavilySearchResults(max_results=1)]\n",
|
||
"\n",
|
||
"# Choose the LLM that will drive the agent\n",
|
||
"# Only certain models support this\n",
|
||
"chat = ChatOpenAI(model=\"gpt-3.5-turbo-1106\", temperature=0)"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "markdown",
|
||
"metadata": {},
|
||
"source": [
|
||
"To make our agent conversational, we must also choose a prompt with a placeholder for our chat history. Here's an example:"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "code",
|
||
"execution_count": 3,
|
||
"metadata": {},
|
||
"outputs": [],
|
||
"source": [
|
||
"from langchain_core.prompts import ChatPromptTemplate, MessagesPlaceholder\n",
|
||
"\n",
|
||
"# Adapted from https://smith.langchain.com/hub/hwchase17/openai-tools-agent\n",
|
||
"prompt = ChatPromptTemplate.from_messages(\n",
|
||
" [\n",
|
||
" (\n",
|
||
" \"system\",\n",
|
||
" \"You are a helpful assistant. You may not need to use tools for every query - the user may just want to chat!\",\n",
|
||
" ),\n",
|
||
" MessagesPlaceholder(variable_name=\"messages\"),\n",
|
||
" MessagesPlaceholder(variable_name=\"agent_scratchpad\"),\n",
|
||
" ]\n",
|
||
")"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "markdown",
|
||
"metadata": {},
|
||
"source": [
|
||
"Great! Now let's assemble our agent:"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "code",
|
||
"execution_count": 4,
|
||
"metadata": {},
|
||
"outputs": [],
|
||
"source": [
|
||
"from langchain.agents import AgentExecutor, create_openai_tools_agent\n",
|
||
"\n",
|
||
"agent = create_openai_tools_agent(chat, tools, prompt)\n",
|
||
"\n",
|
||
"agent_executor = AgentExecutor(agent=agent, tools=tools, verbose=True)"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "markdown",
|
||
"metadata": {},
|
||
"source": [
|
||
"## Running the agent\n",
|
||
"\n",
|
||
"Now that we've set up our agent, let's try interacting with it! It can handle both trivial queries that require no lookup:"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "code",
|
||
"execution_count": 5,
|
||
"metadata": {},
|
||
"outputs": [
|
||
{
|
||
"name": "stdout",
|
||
"output_type": "stream",
|
||
"text": [
|
||
"\n",
|
||
"\n",
|
||
"\u001b[1m> Entering new AgentExecutor chain...\u001b[0m\n",
|
||
"\u001b[32;1m\u001b[1;3mHello Nemo! It's great to meet you. How can I assist you today?\u001b[0m\n",
|
||
"\n",
|
||
"\u001b[1m> Finished chain.\u001b[0m\n"
|
||
]
|
||
},
|
||
{
|
||
"data": {
|
||
"text/plain": [
|
||
"{'messages': [HumanMessage(content=\"I'm Nemo!\")],\n",
|
||
" 'output': \"Hello Nemo! It's great to meet you. How can I assist you today?\"}"
|
||
]
|
||
},
|
||
"execution_count": 5,
|
||
"metadata": {},
|
||
"output_type": "execute_result"
|
||
}
|
||
],
|
||
"source": [
|
||
"from langchain_core.messages import HumanMessage\n",
|
||
"\n",
|
||
"agent_executor.invoke({\"messages\": [HumanMessage(content=\"I'm Nemo!\")]})"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "markdown",
|
||
"metadata": {},
|
||
"source": [
|
||
"Or, it can use of the passed search tool to get up to date information if needed:"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "code",
|
||
"execution_count": 6,
|
||
"metadata": {},
|
||
"outputs": [
|
||
{
|
||
"name": "stdout",
|
||
"output_type": "stream",
|
||
"text": [
|
||
"\n",
|
||
"\n",
|
||
"\u001b[1m> Entering new AgentExecutor chain...\u001b[0m\n",
|
||
"\u001b[32;1m\u001b[1;3m\n",
|
||
"Invoking: `tavily_search_results_json` with `{'query': 'current conservation status of the Great Barrier Reef'}`\n",
|
||
"\n",
|
||
"\n",
|
||
"\u001b[0m\u001b[36;1m\u001b[1;3m[{'url': 'https://www.barrierreef.org/news/blog/this-is-the-critical-decade-for-coral-reef-survival', 'content': \"global coral reef conservation. © 2024 Great Barrier Reef Foundation. Website by bigfish.tv #Related News · 29 January 2024 290m more baby corals to help restore and protect the Great Barrier Reef Great Barrier Reef Foundation Managing Director Anna Marsden says it’s not too late if we act now.The Status of Coral Reefs of the World: 2020 report is the largest analysis of global coral reef health ever undertaken. It found that 14 per cent of the world's coral has been lost since 2009. The report also noted, however, that some of these corals recovered during the 10 years to 2019.\"}]\u001b[0m\u001b[32;1m\u001b[1;3mThe current conservation status of the Great Barrier Reef is a critical concern. According to the Great Barrier Reef Foundation, the Status of Coral Reefs of the World: 2020 report found that 14% of the world's coral has been lost since 2009. However, the report also noted that some of these corals recovered during the 10 years to 2019. For more information, you can visit the following link: [Great Barrier Reef Foundation - Conservation Status](https://www.barrierreef.org/news/blog/this-is-the-critical-decade-for-coral-reef-survival)\u001b[0m\n",
|
||
"\n",
|
||
"\u001b[1m> Finished chain.\u001b[0m\n"
|
||
]
|
||
},
|
||
{
|
||
"data": {
|
||
"text/plain": [
|
||
"{'messages': [HumanMessage(content='What is the current conservation status of the Great Barrier Reef?')],\n",
|
||
" 'output': \"The current conservation status of the Great Barrier Reef is a critical concern. According to the Great Barrier Reef Foundation, the Status of Coral Reefs of the World: 2020 report found that 14% of the world's coral has been lost since 2009. However, the report also noted that some of these corals recovered during the 10 years to 2019. For more information, you can visit the following link: [Great Barrier Reef Foundation - Conservation Status](https://www.barrierreef.org/news/blog/this-is-the-critical-decade-for-coral-reef-survival)\"}"
|
||
]
|
||
},
|
||
"execution_count": 6,
|
||
"metadata": {},
|
||
"output_type": "execute_result"
|
||
}
|
||
],
|
||
"source": [
|
||
"agent_executor.invoke(\n",
|
||
" {\n",
|
||
" \"messages\": [\n",
|
||
" HumanMessage(\n",
|
||
" content=\"What is the current conservation status of the Great Barrier Reef?\"\n",
|
||
" )\n",
|
||
" ],\n",
|
||
" }\n",
|
||
")"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "markdown",
|
||
"metadata": {},
|
||
"source": [
|
||
"## Conversational responses\n",
|
||
"\n",
|
||
"Because our prompt contains a placeholder for chat history messages, our agent can also take previous interactions into account and respond conversationally like a standard chatbot:"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "code",
|
||
"execution_count": 7,
|
||
"metadata": {},
|
||
"outputs": [
|
||
{
|
||
"name": "stdout",
|
||
"output_type": "stream",
|
||
"text": [
|
||
"\n",
|
||
"\n",
|
||
"\u001b[1m> Entering new AgentExecutor chain...\u001b[0m\n",
|
||
"\u001b[32;1m\u001b[1;3mYour name is Nemo!\u001b[0m\n",
|
||
"\n",
|
||
"\u001b[1m> Finished chain.\u001b[0m\n"
|
||
]
|
||
},
|
||
{
|
||
"data": {
|
||
"text/plain": [
|
||
"{'messages': [HumanMessage(content=\"I'm Nemo!\"),\n",
|
||
" AIMessage(content='Hello Nemo! How can I assist you today?'),\n",
|
||
" HumanMessage(content='What is my name?')],\n",
|
||
" 'output': 'Your name is Nemo!'}"
|
||
]
|
||
},
|
||
"execution_count": 7,
|
||
"metadata": {},
|
||
"output_type": "execute_result"
|
||
}
|
||
],
|
||
"source": [
|
||
"from langchain_core.messages import AIMessage, HumanMessage\n",
|
||
"\n",
|
||
"agent_executor.invoke(\n",
|
||
" {\n",
|
||
" \"messages\": [\n",
|
||
" HumanMessage(content=\"I'm Nemo!\"),\n",
|
||
" AIMessage(content=\"Hello Nemo! How can I assist you today?\"),\n",
|
||
" HumanMessage(content=\"What is my name?\"),\n",
|
||
" ],\n",
|
||
" }\n",
|
||
")"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "markdown",
|
||
"metadata": {},
|
||
"source": [
|
||
"If preferred, you can also wrap the agent executor in a `RunnableWithMessageHistory` class to internally manage history messages. First, we need to slightly modify the prompt to take a separate input variable so that the wrapper can parse which input value to store as history:"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "code",
|
||
"execution_count": 8,
|
||
"metadata": {},
|
||
"outputs": [],
|
||
"source": [
|
||
"# Adapted from https://smith.langchain.com/hub/hwchase17/openai-tools-agent\n",
|
||
"prompt = ChatPromptTemplate.from_messages(\n",
|
||
" [\n",
|
||
" (\n",
|
||
" \"system\",\n",
|
||
" \"You are a helpful assistant. You may not need to use tools for every query - the user may just want to chat!\",\n",
|
||
" ),\n",
|
||
" MessagesPlaceholder(variable_name=\"chat_history\"),\n",
|
||
" (\"human\", \"{input}\"),\n",
|
||
" MessagesPlaceholder(variable_name=\"agent_scratchpad\"),\n",
|
||
" ]\n",
|
||
")\n",
|
||
"\n",
|
||
"agent = create_openai_tools_agent(chat, tools, prompt)\n",
|
||
"\n",
|
||
"agent_executor = AgentExecutor(agent=agent, tools=tools, verbose=True)"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "markdown",
|
||
"metadata": {},
|
||
"source": [
|
||
"Then, because our agent executor has multiple outputs, we also have to set the `output_messages_key` property when initializing the wrapper:"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "code",
|
||
"execution_count": 9,
|
||
"metadata": {},
|
||
"outputs": [],
|
||
"source": [
|
||
"from langchain_community.chat_message_histories import ChatMessageHistory\n",
|
||
"from langchain_core.runnables.history import RunnableWithMessageHistory\n",
|
||
"\n",
|
||
"demo_ephemeral_chat_history_for_chain = ChatMessageHistory()\n",
|
||
"\n",
|
||
"conversational_agent_executor = RunnableWithMessageHistory(\n",
|
||
" agent_executor,\n",
|
||
" lambda session_id: demo_ephemeral_chat_history_for_chain,\n",
|
||
" input_messages_key=\"input\",\n",
|
||
" output_messages_key=\"output\",\n",
|
||
" history_messages_key=\"chat_history\",\n",
|
||
")"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "code",
|
||
"execution_count": 10,
|
||
"metadata": {},
|
||
"outputs": [
|
||
{
|
||
"name": "stdout",
|
||
"output_type": "stream",
|
||
"text": [
|
||
"\n",
|
||
"\n",
|
||
"\u001b[1m> Entering new AgentExecutor chain...\u001b[0m\n",
|
||
"\u001b[32;1m\u001b[1;3mHi Nemo! It's great to meet you. How can I assist you today?\u001b[0m\n",
|
||
"\n",
|
||
"\u001b[1m> Finished chain.\u001b[0m\n"
|
||
]
|
||
},
|
||
{
|
||
"data": {
|
||
"text/plain": [
|
||
"{'input': \"I'm Nemo!\",\n",
|
||
" 'chat_history': [],\n",
|
||
" 'output': \"Hi Nemo! It's great to meet you. How can I assist you today?\"}"
|
||
]
|
||
},
|
||
"execution_count": 10,
|
||
"metadata": {},
|
||
"output_type": "execute_result"
|
||
}
|
||
],
|
||
"source": [
|
||
"conversational_agent_executor.invoke(\n",
|
||
" {\n",
|
||
" \"input\": \"I'm Nemo!\",\n",
|
||
" },\n",
|
||
" {\"configurable\": {\"session_id\": \"unused\"}},\n",
|
||
")"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "code",
|
||
"execution_count": 11,
|
||
"metadata": {},
|
||
"outputs": [
|
||
{
|
||
"name": "stdout",
|
||
"output_type": "stream",
|
||
"text": [
|
||
"\n",
|
||
"\n",
|
||
"\u001b[1m> Entering new AgentExecutor chain...\u001b[0m\n",
|
||
"\u001b[32;1m\u001b[1;3mYour name is Nemo! How can I assist you today, Nemo?\u001b[0m\n",
|
||
"\n",
|
||
"\u001b[1m> Finished chain.\u001b[0m\n"
|
||
]
|
||
},
|
||
{
|
||
"data": {
|
||
"text/plain": [
|
||
"{'input': 'What is my name?',\n",
|
||
" 'chat_history': [HumanMessage(content=\"I'm Nemo!\"),\n",
|
||
" AIMessage(content=\"Hi Nemo! It's great to meet you. How can I assist you today?\")],\n",
|
||
" 'output': 'Your name is Nemo! How can I assist you today, Nemo?'}"
|
||
]
|
||
},
|
||
"execution_count": 11,
|
||
"metadata": {},
|
||
"output_type": "execute_result"
|
||
}
|
||
],
|
||
"source": [
|
||
"conversational_agent_executor.invoke(\n",
|
||
" {\n",
|
||
" \"input\": \"What is my name?\",\n",
|
||
" },\n",
|
||
" {\"configurable\": {\"session_id\": \"unused\"}},\n",
|
||
")"
|
||
]
|
||
},
|
||
{
|
||
"cell_type": "markdown",
|
||
"metadata": {},
|
||
"source": [
|
||
"## Further reading\n",
|
||
"\n",
|
||
"Other types agents can also support conversational responses too - for more, check out the [agents section](/docs/tutorials/agents).\n",
|
||
"\n",
|
||
"For more on tool usage, you can also check out [this use case section](/docs/how_to#tools)."
|
||
]
|
||
}
|
||
],
|
||
"metadata": {
|
||
"kernelspec": {
|
||
"display_name": "Python 3 (ipykernel)",
|
||
"language": "python",
|
||
"name": "python3"
|
||
},
|
||
"language_info": {
|
||
"codemirror_mode": {
|
||
"name": "ipython",
|
||
"version": 3
|
||
},
|
||
"file_extension": ".py",
|
||
"mimetype": "text/x-python",
|
||
"name": "python",
|
||
"nbconvert_exporter": "python",
|
||
"pygments_lexer": "ipython3",
|
||
"version": "3.10.1"
|
||
}
|
||
},
|
||
"nbformat": 4,
|
||
"nbformat_minor": 2
|
||
}
|