github/langchain
1
0
Fork 0
mirror of https://github.com/hwchase17/langchain.git synced 2025-09-05 21:12:48 +00:00
Code Issues Packages Projects Releases Wiki Activity

Bagatur/gateway chat (#8198)

Browse Source 
Signed-off-by: dbczumar <corey.zumar@databricks.com>
Co-authored-by: dbczumar <corey.zumar@databricks.com>
This commit is contained in:
Bagatur
2023-07-24 12:17:00 -07:00
committed by GitHub
parent ae28568e2a
commit 1a7d8667c8
5 changed files with 266 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

25
docs/extras/integrations/providers/mlflow_ai_gateway.mdx
View File

@@ -90,6 +90,31 @@ print(embeddings.embed_query("hello"))
print(embeddings.embed_documents(["hello"]))
```
## Chat Example
```python
from langchain.chat_models import ChatMLflowAIGateway
from langchain.schema import HumanMessage, SystemMessage
chat = ChatMLflowAIGateway(
gateway_uri="http://127.0.0.1:5000",
route="chat",
params={
"temperature": 0.1
}
)
messages = [
SystemMessage(
content="You are a helpful assistant that translates English to French."
),
HumanMessage(
content="Translate this sentence from English to French: I love programming."
),
]
print(chat(messages))
```
## Databricks MLflow AI Gateway
Databricks MLflow AI Gateway is in private preview.