mirror of
https://github.com/hwchase17/langchain.git
synced 2025-08-31 18:38:48 +00:00
2fb27b63f5
- docs: for the Ollama notebooks, improve the specificity of some links, add `homebrew` install info, update some wording - tests: reduce number of local models needed to run in half from 4 → 2 (shedding 8gb of required installs) - bump deps (non-breaking) in anticipation of upcoming "thinking" PR
1.5 KiB
1.5 KiB
langchain-ollama
This package contains the LangChain integration with Ollama
Installation
pip install -U langchain-ollama
For the package to work, you will need to install and run the Ollama server locally (download).
To run integration tests (make integration_tests), you will need the following models installed in your Ollama server:
llama3.1deepseek-r1:1.5b
Install these models by running:
ollama pull <name-of-model>
Chat Models
ChatOllama class exposes chat models from Ollama.
from langchain_ollama import ChatOllama
llm = ChatOllama(model="llama3.1")
llm.invoke("Sing a ballad of LangChain.")
Embeddings
OllamaEmbeddings class exposes embeddings from Ollama.
from langchain_ollama import OllamaEmbeddings
embeddings = OllamaEmbeddings(model="llama3.1")
embeddings.embed_query("What is the meaning of life?")
LLMs
OllamaLLM class exposes traditional LLMs from Ollama.
from langchain_ollama import OllamaLLM
llm = OllamaLLM(model="llama3.1")
llm.invoke("The meaning of life is")