langchain/libs
eryk-dsai 675d57df50
New LLM integration: Ctranslate2 (#10400)
## Description:

I've integrated CTranslate2 with LangChain. CTranlate2 is a recently
popular library for efficient inference with Transformer models that
compares favorably to alternatives such as HF Text Generation Inference
and vLLM in
[benchmarks](https://hamel.dev/notes/llm/inference/03_inference.html).
2023-09-09 13:19:00 -07:00
..
experimental Konko fix dependency 2023-09-08 10:06:37 -07:00
langchain New LLM integration: Ctranslate2 (#10400) 2023-09-09 13:19:00 -07:00