langchain

mirror of https://github.com/hwchase17/langchain.git synced 2025-09-28 23:07:11 +00:00

Files

Sydney Runkle 263c215112 perf[core]: remove generations summation from hot loop (#31231 )

1. Removes summation of `ChatGenerationChunk` from hot loops in `stream`
and `astream`
2. Removes run id gen from loop as well (minor impact)

Again, benchmarking on processing ~200k chunks (a poem about broccoli).

Before: ~4.2s

Blue circle is all the time spent adding up gen chunks

<img width="1345" alt="Screenshot 2025-05-14 at 7 48 33 AM"
src="https://github.com/user-attachments/assets/08a59d78-134d-4cd3-9d54-214de689df51"
/>

After: ~2.3s

Blue circle is remaining time spent on adding chunks, which can be
minimized in a future PR by optimizing the `merge_content`,
`merge_dicts`, and `merge_lists` utilities.

<img width="1353" alt="Screenshot 2025-05-14 at 7 50 08 AM"
src="https://github.com/user-attachments/assets/df6b3506-929e-4b6d-b198-7c4e992c6d34"
/>

2025-05-14 08:13:05 -07:00

cli

packaging: remove Python upper bound for langchain and co libs (#31025 )

2025-04-28 14:44:28 -04:00

community

community: move to separate repo (continued) (#31069 )

2025-04-29 09:25:32 -04:00

core

perf[core]: remove generations summation from hot loop (#31231 )

2025-05-14 08:13:05 -07:00

experimental

…