Mshari 9383b78be1 feat(groq): add prompt caching token usage details (#33708) ...

**Description:** 
Adds support for prompt caching usage metadata in ChatGroq. The
integration now captures cached token information from the Groq API
response and includes it in the `input_token_details` field of the
`usage_metadata`.

Changes:
- Created new `_create_usage_metadata()` helper function to centralize
usage metadata creation logic
- Extracts `cached_tokens` from `prompt_tokens_details` in API responses
and maps to `input_token_details.cache_read`
- Integrated the helper function in both streaming
(`_convert_chunk_to_message_chunk`) and non-streaming
(`_create_chat_result`) code paths
- Added comprehensive unit tests to verify caching metadata handling and
backward compatibility

This enables users to monitor prompt caching effectiveness when using
Groq models with prompt caching enabled.

**Issue:** N/A

**Dependencies:** None

---------

Co-authored-by: Mason Daugherty <github@mdrxy.com>
Co-authored-by: Mason Daugherty <mason@langchain.dev>

2025-11-07 17:05:22 -05:00

..

cassettes

chore(groq): fix integration tests (#33478)

2025-10-14 14:16:34 +00:00

integration_tests

fix(docs): Fix several typos and grammar (#33487)

2025-10-14 20:04:14 -04:00

unit_tests

feat(groq): add prompt caching token usage details (#33708)

2025-11-07 17:05:22 -05:00

__init__.py

…

conftest.py

feat(groq): support built-in tools in message content (#33459)

2025-10-13 15:06:01 -04:00