github/langchain
1
0
Fork 0
mirror of https://github.com/hwchase17/langchain.git synced 2025-09-21 18:39:57 +00:00
Code Issues Packages Projects Releases Wiki Activity

community[patch]: Support Streaming in Azure Machine Learning (#18246)

Browse Source 
- [x] **PR title**: "community: Support streaming in Azure ML and few
naming changes"

- [x] **PR message**:
- **Description:** Added support for streaming for azureml_endpoint.
Also, renamed and AzureMLEndpointApiType.realtime to
AzureMLEndpointApiType.dedicated. Also, added new classes
CustomOpenAIChatContentFormatter and CustomOpenAIContentFormatter and
updated the classes LlamaChatContentFormatter and LlamaContentFormatter
to now show a deprecated warning message when instantiated.

---------

Co-authored-by: Sachin Paryani <saparan@microsoft.com>
Co-authored-by: Bagatur <baskaryan@gmail.com>
This commit is contained in:
Sachin Paryani
2024-03-28 16:38:20 -07:00
committed by GitHub
parent ecb11a4a32
commit 25c9f3d1d1
6 changed files with 285 additions and 76 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
libs/langchain/langchain/llms/azureml_endpoint.py
View File

@@ -2,10 +2,10 @@ from langchain_community.llms.azureml_endpoint import (
AzureMLEndpointClient,
AzureMLOnlineEndpoint,
ContentFormatterBase,
CustomOpenAIContentFormatter,
DollyContentFormatter,
GPT2ContentFormatter,
HFContentFormatter,
LlamaContentFormatter,
OSSContentFormatter,
)
@@ -16,6 +16,6 @@ __all__ = [
"OSSContentFormatter",
"HFContentFormatter",
"DollyContentFormatter",
"LlamaContentFormatter",
"CustomOpenAIContentFormatter",
"AzureMLOnlineEndpoint",
]