github/langchain
1
0
Fork 0
mirror of https://github.com/hwchase17/langchain.git synced 2025-09-01 19:12:42 +00:00
Code Issues Packages Projects Releases Wiki Activity

community[minor]: Add Aphrodite Engine support (#14759)

Browse Source 
This PR adds support for PygmalionAI's [Aphrodite
Engine](https://github.com/PygmalionAI/aphrodite-engine), based on
vLLM's attention mechanism. At the moment, this PR does not include
support for the API servers, but they will be added in a later PR.

The only dependency as of now is `aphrodite-engine==0.4.2`. We pin the
version to prevent breakage due to changes in the aphrodite-engine
library.

---------

Co-authored-by: Bagatur <baskaryan@gmail.com>
This commit is contained in:
AlpinDale
2023-12-20 06:16:57 +00:00
committed by GitHub
parent d21f44b484
commit b0588774f1
4 changed files with 520 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
libs/community/tests/unit_tests/llms/test_imports.py
View File

@@ -8,6 +8,7 @@ EXPECT_ALL = [
"AmazonAPIGateway",
"Anthropic",
"Anyscale",
"Aphrodite",
"Arcee",
"Aviary",
"AzureMLOnlineEndpoint",