github/langchain
1
0
Fork 0
mirror of https://github.com/hwchase17/langchain.git synced 2025-06-19 13:23:35 +00:00
Code Issues Packages Projects Releases Wiki Activity

community[patch]: Add "model" attribute to the payload sent to Ollama in ChatOllama (#20354)

Browse Source 
Example Ollama API calls:

Request without "model":
```
curl --location 'http://localhost:11434/api/chat' \
--header 'Content-Type: application/json' \
--data '{
  "messages": [
    {
      "role": "user",
      "content": "What is the capitol of PA?"
    }
  ],
  "stream": false
}'
```
Response:
```
{"error":"model is required"}
```

Request with "model":
```
curl --location 'http://localhost:11434/api/chat' \
--header 'Content-Type: application/json' \
--data '{
  "model": "openchat",
  "messages": [
    {
      "role": "user",
      "content": "What is the capitol of PA?"
    }
  ],
  "stream": false
}'
```

Response:
```
{
  "eval_duration" : 733248000,
  "created_at" : "2024-04-11T23:04:08.735766843Z",
  "model" : "openchat",
  "message" : {
    "content" : " The capital city of Pennsylvania is Harrisburg.",
    "role" : "assistant"
  },
  "total_duration" : 3138731168,
  "prompt_eval_count" : 25,
  "load_duration" : 466562959,
  "done" : true,
  "prompt_eval_duration" : 1938495000,
  "eval_count" : 10
}
```
This commit is contained in:
P. Taylor Goetz 2024-04-12 13:32:53 -04:00 committed by GitHub
parent 57bb940c17
commit 9317df7f16
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 2 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
libs/community/langchain_community/chat_models/ollama.py
View File

@ -156,6 +156,7 @@ class ChatOllama(BaseChatModel, _OllamaCommon):
**kwargs: Any, **kwargs: Any,
) -> Iterator[str]: ) -> Iterator[str]:
payload = { payload = {
"model": self.model,
"messages": self._convert_messages_to_ollama_messages(messages), "messages": self._convert_messages_to_ollama_messages(messages),
} }
yield from self._create_stream( yield from self._create_stream(
@ -169,6 +170,7 @@ class ChatOllama(BaseChatModel, _OllamaCommon):
**kwargs: Any, **kwargs: Any,
) -> AsyncIterator[str]: ) -> AsyncIterator[str]:
payload = { payload = {
"model": self.model,
"messages": self._convert_messages_to_ollama_messages(messages), "messages": self._convert_messages_to_ollama_messages(messages),
} }
async for stream_resp in self._acreate_stream( async for stream_resp in self._acreate_stream(