github/langchain
1
0
Fork 0
mirror of https://github.com/hwchase17/langchain.git synced 2025-09-24 20:09:01 +00:00
Code Issues Packages Projects Releases Wiki Activity

core, partners: add token usage attribute to AIMessage (#21944)

Browse Source 
```python
class UsageMetadata(TypedDict):
    """Usage metadata for a message, such as token counts.

    Attributes:
        input_tokens: (int) count of input (or prompt) tokens
        output_tokens: (int) count of output (or completion) tokens
        total_tokens: (int) total token count
    """

    input_tokens: int
    output_tokens: int
    total_tokens: int
```
```python
class AIMessage(BaseMessage):
    ...
    usage_metadata: Optional[UsageMetadata] = None
    """If provided, token usage information associated with the message."""
    ...
```
This commit is contained in:
ccurme
2024-05-23 14:21:58 -04:00
committed by GitHub
parent 3d26807b92
commit fbfed65fb1
13 changed files with 364 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

11
libs/partners/groq/tests/integration_tests/test_standard.py
View File

@@ -14,6 +14,17 @@ class TestMistralStandard(ChatModelIntegrationTests):
def chat_model_class(self) -> Type[BaseChatModel]:
return ChatGroq
@pytest.mark.xfail(reason="Not implemented.")
def test_usage_metadata(
self,
chat_model_class: Type[BaseChatModel],
chat_model_params: dict,
) -> None:
super().test_usage_metadata(
chat_model_class,
chat_model_params,
)
@pytest.mark.xfail(reason="Not yet implemented.")
def test_tool_message_histories_list_content(
self,