mirror of
https://github.com/hwchase17/langchain.git
synced 2025-12-24 00:17:05 +00:00
This PR adds support for PygmalionAI's [Aphrodite Engine](https://github.com/PygmalionAI/aphrodite-engine), based on vLLM's attention mechanism. At the moment, this PR does not include support for the API servers, but they will be added in a later PR. The only dependency as of now is `aphrodite-engine==0.4.2`. We pin the version to prevent breakage due to changes in the aphrodite-engine library. --------- Co-authored-by: Bagatur <baskaryan@gmail.com>
LangChain Documentation
For more information on contributing to our documentation, see the Documentation Contributing Guide