langchain/libs/community/tests/unit_tests/callbacks
Vignesh A 4c9acdfbf1
Community : Add OpenAI prompt caching and reasoning tokens tracking (#27135)
Added Token tracking for OpenAI's prompt caching and reasoning tokens
Costs updated from https://openai.com/api/pricing/

usage example
```python
from langchain_community.callbacks import get_openai_callback
from langchain_openai import ChatOpenAI
llm = ChatOpenAI(model_name="o1-mini",temperature=1)

with get_openai_callback() as cb:
    response = llm.invoke("hi "*1500)
    print(cb)
```
Output
```
Tokens Used: 1720
	Prompt Tokens: 1508
		Prompt Tokens Cached: 1408
	Completion Tokens: 212
		Reasoning Tokens: 192
Successful Requests: 1
Total Cost (USD): $0.0049559999999999995
```

---------

Co-authored-by: Chester Curme <chester.curme@gmail.com>
2024-12-19 09:31:13 -05:00
..
tracers Delete V1 tracer and refactor tracer tests to core (#15326) 2023-12-29 15:55:56 -08:00
__init__.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 2023-12-11 13:53:30 -08:00
fake_callback_handler.py multiple: pydantic 2 compatibility, v0.3 (#26443) 2024-09-13 14:38:45 -07:00
test_callback_manager.py core[patch]: Fix "argument of type 'NoneType' is not iterable" error in LangChainTracer (#26576) 2024-09-17 10:29:46 -07:00
test_imports.py community[minor]: Add UpstashRatelimitHandler (#21885) 2024-06-07 21:02:06 +00:00
test_openai_info.py Community : Add OpenAI prompt caching and reasoning tokens tracking (#27135) 2024-12-19 09:31:13 -05:00
test_streamlit_callback.py community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463) 2023-12-11 13:53:30 -08:00
test_upstash_ratelimit_callback.py community[minor]: Add UpstashRatelimitHandler (#21885) 2024-06-07 21:02:06 +00:00