mirror of
https://github.com/hwchase17/langchain.git
synced 2026-04-03 19:04:23 +00:00
Use docusaurus versioning with a callout, merged master as well @hwchase17 @baskaryan --------- Signed-off-by: Weichen Xu <weichen.xu@databricks.com> Signed-off-by: Rahul Tripathi <rauhl.psit.ec@gmail.com> Co-authored-by: Leonid Ganeline <leo.gan.57@gmail.com> Co-authored-by: Leonid Kuligin <lkuligin@yandex.ru> Co-authored-by: Averi Kitsch <akitsch@google.com> Co-authored-by: Erick Friis <erick@langchain.dev> Co-authored-by: Nuno Campos <nuno@langchain.dev> Co-authored-by: Nuno Campos <nuno@boringbits.io> Co-authored-by: Bagatur <22008038+baskaryan@users.noreply.github.com> Co-authored-by: Eugene Yurtsev <eyurtsev@gmail.com> Co-authored-by: Martín Gotelli Ferenaz <martingotelliferenaz@gmail.com> Co-authored-by: Fayfox <admin@fayfox.com> Co-authored-by: Eugene Yurtsev <eugene@langchain.dev> Co-authored-by: Dawson Bauer <105886620+djbauer2@users.noreply.github.com> Co-authored-by: Ravindu Somawansa <ravindu.somawansa@gmail.com> Co-authored-by: Dhruv Chawla <43818888+Dominastorm@users.noreply.github.com> Co-authored-by: ccurme <chester.curme@gmail.com> Co-authored-by: Bagatur <baskaryan@gmail.com> Co-authored-by: WeichenXu <weichen.xu@databricks.com> Co-authored-by: Benito Geordie <89472452+benitoThree@users.noreply.github.com> Co-authored-by: kartikTAI <129414343+kartikTAI@users.noreply.github.com> Co-authored-by: Kartik Sarangmath <kartik@thirdai.com> Co-authored-by: Sevin F. Varoglu <sfvaroglu@octoml.ai> Co-authored-by: MacanPN <martin.triska@gmail.com> Co-authored-by: Prashanth Rao <35005448+prrao87@users.noreply.github.com> Co-authored-by: Hyeongchan Kim <kozistr@gmail.com> Co-authored-by: sdan <git@sdan.io> Co-authored-by: Guangdong Liu <liugddx@gmail.com> Co-authored-by: Rahul Triptahi <rahul.psit.ec@gmail.com> Co-authored-by: Rahul Tripathi <rauhl.psit.ec@gmail.com> Co-authored-by: pjb157 <84070455+pjb157@users.noreply.github.com> Co-authored-by: Eun Hye Kim <ehkim1440@gmail.com> Co-authored-by: kaijietti <43436010+kaijietti@users.noreply.github.com> Co-authored-by: Pengcheng Liu <pcliu.fd@gmail.com> Co-authored-by: Tomer Cagan <tomer@tomercagan.com> Co-authored-by: Christophe Bornet <cbornet@hotmail.com>
89 lines
3.8 KiB
Plaintext
89 lines
3.8 KiB
Plaintext
# Datadog Tracing
|
|
|
|
>[ddtrace](https://github.com/DataDog/dd-trace-py) is a Datadog application performance monitoring (APM) library which provides an integration to monitor your LangChain application.
|
|
|
|
Key features of the ddtrace integration for LangChain:
|
|
- Traces: Capture LangChain requests, parameters, prompt-completions, and help visualize LangChain operations.
|
|
- Metrics: Capture LangChain request latency, errors, and token/cost usage (for OpenAI LLMs and chat models).
|
|
- Logs: Store prompt completion data for each LangChain operation.
|
|
- Dashboard: Combine metrics, logs, and trace data into a single plane to monitor LangChain requests.
|
|
- Monitors: Provide alerts in response to spikes in LangChain request latency or error rate.
|
|
|
|
Note: The ddtrace LangChain integration currently provides tracing for LLMs, chat models, Text Embedding Models, Chains, and Vectorstores.
|
|
|
|
## Installation and Setup
|
|
|
|
1. Enable APM and StatsD in your Datadog Agent, along with a Datadog API key. For example, in Docker:
|
|
|
|
```
|
|
docker run -d --cgroupns host \
|
|
--pid host \
|
|
-v /var/run/docker.sock:/var/run/docker.sock:ro \
|
|
-v /proc/:/host/proc/:ro \
|
|
-v /sys/fs/cgroup/:/host/sys/fs/cgroup:ro \
|
|
-e DD_API_KEY=<DATADOG_API_KEY> \
|
|
-p 127.0.0.1:8126:8126/tcp \
|
|
-p 127.0.0.1:8125:8125/udp \
|
|
-e DD_DOGSTATSD_NON_LOCAL_TRAFFIC=true \
|
|
-e DD_APM_ENABLED=true \
|
|
gcr.io/datadoghq/agent:latest
|
|
```
|
|
|
|
2. Install the Datadog APM Python library.
|
|
|
|
```
|
|
pip install ddtrace>=1.17
|
|
```
|
|
|
|
|
|
3. The LangChain integration can be enabled automatically when you prefix your LangChain Python application command with `ddtrace-run`:
|
|
|
|
```
|
|
DD_SERVICE="my-service" DD_ENV="staging" DD_API_KEY=<DATADOG_API_KEY> ddtrace-run python <your-app>.py
|
|
```
|
|
|
|
**Note**: If the Agent is using a non-default hostname or port, be sure to also set `DD_AGENT_HOST`, `DD_TRACE_AGENT_PORT`, or `DD_DOGSTATSD_PORT`.
|
|
|
|
Additionally, the LangChain integration can be enabled programmatically by adding `patch_all()` or `patch(langchain=True)` before the first import of `langchain` in your application.
|
|
|
|
Note that using `ddtrace-run` or `patch_all()` will also enable the `requests` and `aiohttp` integrations which trace HTTP requests to LLM providers, as well as the `openai` integration which traces requests to the OpenAI library.
|
|
|
|
```python
|
|
from ddtrace import config, patch
|
|
|
|
# Note: be sure to configure the integration before calling ``patch()``!
|
|
# e.g. config.langchain["logs_enabled"] = True
|
|
|
|
patch(langchain=True)
|
|
|
|
# to trace synchronous HTTP requests
|
|
# patch(langchain=True, requests=True)
|
|
|
|
# to trace asynchronous HTTP requests (to the OpenAI library)
|
|
# patch(langchain=True, aiohttp=True)
|
|
|
|
# to include underlying OpenAI spans from the OpenAI integration
|
|
# patch(langchain=True, openai=True)patch_all
|
|
```
|
|
|
|
See the [APM Python library documentation](https://ddtrace.readthedocs.io/en/stable/installation_quickstart.html) for more advanced usage.
|
|
|
|
|
|
## Configuration
|
|
|
|
See the [APM Python library documentation](https://ddtrace.readthedocs.io/en/stable/integrations.html#langchain) for all the available configuration options.
|
|
|
|
|
|
### Log Prompt & Completion Sampling
|
|
|
|
To enable log prompt and completion sampling, set the `DD_LANGCHAIN_LOGS_ENABLED=1` environment variable. By default, 10% of traced requests will emit logs containing the prompts and completions.
|
|
|
|
To adjust the log sample rate, see the [APM library documentation](https://ddtrace.readthedocs.io/en/stable/integrations.html#langchain).
|
|
|
|
**Note**: Logs submission requires `DD_API_KEY` to be specified when running `ddtrace-run`.
|
|
|
|
|
|
## Troubleshooting
|
|
|
|
Need help? Create an issue on [ddtrace](https://github.com/DataDog/dd-trace-py) or contact [Datadog support](https://docs.datadoghq.com/help/).
|