docs: runnable module description (#17966)

Added a module description. Added `batch` description.
This commit is contained in:
Leonid Ganeline
2024-03-01 10:01:32 -08:00
committed by GitHub
parent 6d0af4e805
commit a89f007947
2 changed files with 21 additions and 1 deletions

View File

@@ -9,7 +9,9 @@ synchronous, asynchronous, batch, and streaming operations.
Support for **async** allows servers hosting LCEL based programs to scale better
for higher concurrent loads.
**Streaming** of intermediate outputs as they're being generated allows for
**Batch** operations allow for processing multiple inputs in parallel.
**Streaming** of intermediate outputs, as they're being generated, allows for
creating more responsive UX.
This module contains schema and implementation of LangChain Runnables primitives.