Mason Daugherty
adff6f48db
addressing comments
2025-08-06 18:19:07 -04:00
Mason Daugherty
c0cc74db46
remove some TODOs, simplify some assertions, format
2025-08-06 18:00:44 -04:00
Mason Daugherty
ad8db57efa
remove pydantic v1 test and unneeded audio test
2025-08-06 16:55:27 -04:00
Mason Daugherty
4d261089c6
more tests refactors
2025-08-06 13:11:46 -04:00
Mason Daugherty
990deaedaf
get ollama passing
2025-08-05 22:26:00 -04:00
Mason Daugherty
652884eeed
xfail instead of fails
2025-08-05 21:31:53 -04:00
Mason Daugherty
20a41ec5df
remove outdated comments
2025-08-05 21:06:44 -04:00
Mason Daugherty
f6b4251357
more formatting/nits
2025-08-05 20:52:00 -04:00
Mason Daugherty
d0e04bc947
lint
2025-08-05 20:40:21 -04:00
Mason Daugherty
e21beb826c
std-tests: unit and integration
2025-08-05 20:27:58 -04:00
Mason Daugherty
cd8d6ae7cd
formatting/nits/docs
2025-08-05 20:25:36 -04:00
Mason Daugherty
2087294760
fmat
2025-08-05 16:15:28 -04:00
Mason Daugherty
85511893f7
readmes
2025-08-05 16:11:36 -04:00
Mason Daugherty
e393f512fc
update README.md
2025-08-05 11:05:26 -04:00
Mason Daugherty
b94fb8c086
update README_V1.md
2025-08-05 11:03:28 -04:00
Mason Daugherty
551663d0b7
namespace refactor
2025-08-05 10:28:07 -04:00
Mason Daugherty
308e734c78
expant unit tests v1
2025-08-04 17:44:14 -04:00
Mason Daugherty
16729de369
add some notes
2025-08-04 17:38:02 -04:00
Mason Daugherty
db41bfe1f8
more tests
2025-08-04 17:31:47 -04:00
Mason Daugherty
2290984cfa
refactoring
2025-08-04 15:54:07 -04:00
Mason Daugherty
2f8470d7f2
formatting
2025-08-04 15:53:32 -04:00
Mason Daugherty
82492d6d89
export v1 tests
2025-08-01 12:53:37 -04:00
Mason Daugherty
eae4d1db43
integration tests
2025-08-01 12:47:08 -04:00
Mason Daugherty
1b2a677eed
first pass (w/o integration)
2025-07-31 17:24:19 -04:00
Mason Daugherty
45533fc875
fix: correct syrupy import
2025-07-31 13:16:55 -04:00
Mason Daugherty
e9bb40f221
nit: lint standard-tests files
2025-07-31 13:15:39 -04:00
Mason Daugherty
5e9eb19a83
chore: update branch with changes from master ( #32277 )
...
Co-authored-by: Maxime Grenu <69890511+cluster2600@users.noreply.github.com>
Co-authored-by: Claude <claude@anthropic.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: jmaillefaud <jonathan.maillefaud@evooq.ch>
Co-authored-by: Eugene Yurtsev <eyurtsev@gmail.com>
Co-authored-by: tanwirahmad <tanwirahmad@users.noreply.github.com>
Co-authored-by: Christophe Bornet <cbornet@hotmail.com>
Co-authored-by: Copilot <198982749+Copilot@users.noreply.github.com>
Co-authored-by: niceg <79145285+growmuye@users.noreply.github.com>
Co-authored-by: Chaitanya varma <varmac301@gmail.com>
Co-authored-by: dishaprakash <57954147+dishaprakash@users.noreply.github.com>
Co-authored-by: Chester Curme <chester.curme@gmail.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Kanav Bansal <13186335+bansalkanav@users.noreply.github.com>
Co-authored-by: Aleksandr Filippov <71711753+alex-feel@users.noreply.github.com>
Co-authored-by: Alex Feel <afilippov@spotware.com>
2025-07-28 10:39:41 -04:00
Mason Daugherty
706a66eccd
fix: automatically fix issues with ruff ( #31897 )
...
* Perform safe automatic fixes instead of only selecting
[isort](https://docs.astral.sh/ruff/rules/#isort-i )
2025-07-07 14:13:10 -04:00
Christophe Bornet
9368b92b2c
standard-tests: Ruff autofixes ( #31862 )
...
Auto-fixes from ruff with rule ALL
2025-07-07 10:27:39 -04:00
Christophe Bornet
1276bf3e1d
standard-tests: Add ruff rules PGH ( #31869 )
...
See https://docs.astral.sh/ruff/rules/#pygrep-hooks-pgh
2025-07-07 10:07:39 -04:00
Christophe Bornet
e1eb3f8d6f
standard-tests: Bump ruff version to 0.12 ( #31865 )
2025-07-05 17:12:00 -04:00
Christophe Bornet
cd7dce687a
standard-tests: Add ruff rule UP (pyupgrade) ( #31842 )
...
See https://docs.astral.sh/ruff/rules/#pyupgrade-up
All auto-fixed
2025-07-03 10:12:31 -04:00
Mason Daugherty
6d71b6b6ee
standard-tests: refactoring and fixes ( #31703 )
...
- `libs/core/langchain_core/messages/base.py`: add model name to
examples [per
docs](https://python.langchain.com/api_reference/standard_tests/integration_tests/langchain_tests.integration_tests.chat_models.ChatModelIntegrationTests.html#langchain_tests.integration_tests.chat_models.ChatModelIntegrationTests.test_usage_metadata )
("0.3.17: Additionally check for the presence of model_name in the
response metadata, which is needed for usage tracking in callback
handlers")
- `libs/core/langchain_core/utils/function_calling.py`: correct typo
-
`libs/standard-tests/langchain_tests/integration_tests/chat_models.py`:
- `magic_function(input)` -> `magic_function(_input)` to prevent warning
about redefining built in `input`
- relocate a few tests for better grouping and narrative flow
- suppress some type hint warnings following suit from similar tests
- fix a few more typos
- validate not only that `model_name` is defined, but that it is not
empty (test_usage_metadata)
2025-06-23 23:22:31 +00:00
Mason Daugherty
a79998800c
fix: correct typo in docstring for three_values fixture ( #31638 )
...
Docstring typo fix in `base_store.py`
2025-06-17 16:51:07 -04:00
ccurme
9c639035c0
standard-tests: add cache_control to Anthropic inputs test ( #31516 )
2025-06-06 10:00:43 -04:00
ccurme
43bee469ce
standard-tests: release 0.3.20 ( #31499 )
2025-06-05 11:28:18 -04:00
ccurme
d3be4a0c56
infra: remove use of --vcr-record=none ( #31452 )
...
This option is specific to `pytest-vcr`. `pytest-recording` runs in this
mode by default.
2025-06-01 10:49:59 -04:00
ccurme
3db1aa0ba6
standard-tests: migrate to pytest-recording ( #31425 )
...
Co-authored-by: Eugene Yurtsev <eyurtsev@gmail.com>
2025-05-31 15:21:15 -04:00
Sydney Runkle
1917dd1ccd
benchmarks: always run (not conditional on changes) ( #31409 )
2025-05-29 11:45:57 -04:00
ccurme
49eeb0f3c3
standard-tests: add benchmarks ( #31302 )
...
Co-authored-by: Sydney Runkle <sydneymarierunkle@gmail.com>
2025-05-29 15:21:37 +00:00
Sydney Runkle
7e926520d5
packaging: remove Python upper bound for langchain and co libs ( #31025 )
...
Follow up to https://github.com/langchain-ai/langsmith-sdk/pull/1696 ,
I've bumped the `langsmith` version where applicable in `uv.lock`.
Type checking problems here because deps have been updated in
`pyproject.toml` and `uv lock` hasn't been run - we should enforce that
in the future - goes with the other dependabot todos :).
2025-04-28 14:44:28 -04:00
ccurme
ba2518995d
standard-tests: add condition for image tool message test ( #31041 )
...
Require support for [standard
format](https://python.langchain.com/docs/how_to/multimodal_inputs/ ).
2025-04-27 17:24:43 +00:00
ccurme
faef3e5d50
core, standard-tests: support PDF and audio input in Chat Completions format ( #30979 )
...
Chat models currently implement support for:
- images in OpenAI Chat Completions format
- other multimodal types (e.g., PDF and audio) in a cross-provider
[standard
format](https://python.langchain.com/docs/how_to/multimodal_inputs/ )
Here we update core to extend support to PDF and audio input in Chat
Completions format. **If an OAI-format PDF or audio content block is
passed into any chat model, it will be transformed to the LangChain
standard format**. We assume that any chat model supporting OAI-format
PDF or audio has implemented support for the standard format.
2025-04-23 18:32:51 +00:00
ccurme
f01b89df56
standard-tests: release 0.3.19 ( #30906 )
2025-04-17 10:37:44 -04:00
ccurme
add6a78f98
standard-tests, openai[patch]: add support standard audio inputs ( #30904 )
2025-04-17 10:30:57 -04:00
ccurme
6baf5c05a6
standard-tests: release 0.3.18 ( #30854 )
2025-04-15 16:56:54 +00:00
ccurme
9cfe6bcacd
multiple: multi-modal content blocks ( #30746 )
...
Introduces standard content block format for images, audio, and files.
## Examples
Image from url:
```
{
"type": "image",
"source_type": "url",
"url": "https://path.to.image.png ",
}
```
Image, in-line data:
```
{
"type": "image",
"source_type": "base64",
"data": "<base64 string>",
"mime_type": "image/png",
}
```
PDF, in-line data:
```
{
"type": "file",
"source_type": "base64",
"data": "<base64 string>",
"mime_type": "application/pdf",
}
```
File from ID:
```
{
"type": "file",
"source_type": "id",
"id": "file-abc123",
}
```
Plain-text file:
```
{
"type": "file",
"source_type": "text",
"text": "foo bar",
}
```
2025-04-15 09:48:06 -04:00
Sydney Runkle
4556b81b1d
Clean up numpy dependencies and speed up 3.13 CI with numpy>=2.1.0 ( #30714 )
...
Generally, this PR is CI performance focused + aims to clean up some
dependencies at the same time.
1. Unpins upper bounds for `numpy` in all `pyproject.toml` files where
`numpy` is specified
2. Requires `numpy >= 2.1.0` for Python 3.13 and `numpy > v1.26.0` for
Python 3.12, plus a `numpy` min version bump for `chroma`
3. Speeds up CI by minutes - linting on Python 3.13, installing `numpy <
2.1.0` was taking [~3
minutes](https://github.com/langchain-ai/langchain/actions/runs/14316342925/job/40123305868?pr=30713 ),
now the entire env setup takes a few seconds
4. Deleted the `numpy` test dependency from partners where that was not
used, specifically `huggingface`, `voyageai`, `xai`, and `nomic`.
It's a bit unfortunate that `langchain-community` depends on `numpy`, we
might want to try to fix that in the future...
Closes https://github.com/langchain-ai/langchain/issues/26026
Fixes https://github.com/langchain-ai/langchain/issues/30555
2025-04-08 09:45:07 -04:00
ccurme
f68eaab44f
tests: release 0.3.17 ( #30502 )
2025-03-26 18:56:54 +00:00
ccurme
22d1a7d7b6
standard-tests[patch]: require model_name in response_metadata if returns_usage_metadata ( #30497 )
...
We are implementing a token-counting callback handler in
`langchain-core` that is intended to work with all chat models
supporting usage metadata. The callback will aggregate usage metadata by
model. This requires responses to include the model name in its
metadata.
To support this, if a model `returns_usage_metadata`, we check that it
includes a string model name in its `response_metadata` in the
`"model_name"` key.
More context: https://github.com/langchain-ai/langchain/pull/30487
2025-03-26 12:20:53 -04:00
