mirror of
https://github.com/hwchase17/langchain.git
synced 2025-10-22 01:32:24 +00:00
e34f9fd6f7
Anthropic updated how they report token counts during streaming today. See changes to `MessageDeltaUsage` in [this commit](2da00f26c5 (diff-1a396eba0cd9cd8952dcdb58049d3b13f6b7768ead1411888d66e28211f7bfc5)). It's clean and simple to grab these fields from the final `message_delta` event. However, some of them are typed as Optional, and language [here](e42451ab3f/src/anthropic/lib/streaming/_messages.py (L462)) suggests they may not always be present. So here we take the required field from the `message_delta` event as we were doing previously, and ignore the rest.