langchain/docs/extras/modules
Taqi Jaffri 973593c5c7
Added streaming support to Replicate (#8045)
Streaming support is useful if you are doing long-running completions or
need interactivity e.g. for chat... adding it to replicate, using a
similar pattern to other LLMs that support streaming.

Housekeeping: I ran `make format` and `make lint`, no issues reported in
the files I touched.

I did update the replicate integration test but ran into some issues,
specifically:

1. The original test was failing for me due to the model argument not
being specified... perhaps this test is not regularly run? I fixed it by
adding a call to the lightweight hello world model which should not be
burdensome for replicate infra.
2. I couldn't get the `make integration_tests` command to pass... a lot
of failures in other integration tests due to missing dependencies...
however I did make sure the particluar test file I updated does pass, by
running `poetry run pytest
tests/integration_tests/llms/test_replicate.py`

Finally, I am @tjaffri https://twitter.com/tjaffri for feature
announcement tweets... or if you could please tag @docugami
https://twitter.com/docugami we would really appreciate that :-)

Tagging model maintainers @hwchase17  @baskaryan 

Thank for all the awesome work you folks are doing.

---------

Co-authored-by: Taqi Jaffri <tjaffri@docugami.com>
2023-07-20 18:59:54 -07:00
..
agents Add Metaphor new field and reformat docs (#8022) 2023-07-20 15:50:54 -07:00
callbacks Adding Docs for PromptLayerCallbackHandler (#7860) 2023-07-18 07:51:16 -07:00
chains Neptune graph and openCypher QA Chain (#8035) 2023-07-20 18:56:47 -07:00
data_connection Adding endpoint_url to embeddings/bedrock.py and updated docs (#7927) 2023-07-20 07:25:59 -07:00
evaluation Docs Nit (#7918) 2023-07-18 21:47:28 -07:00
memory Fix make docs_build and related scripts (#7276) 2023-07-11 22:05:14 -04:00
model_io Added streaming support to Replicate (#8045) 2023-07-20 18:59:54 -07:00
paul_graham_essay.txt codespell: workflow, config + some (quite a few) typos fixed (#6785) 2023-07-12 16:20:08 -04:00
state_of_the_union.txt Doc refactor (#6300) 2023-06-16 11:52:56 -07:00