Stefano Lottini c9ff0ab2e9 Cassandra support for LLM cache (exact-match and semantic) (#9772) ...

This PR implements two new classes in the cache module: `CassandraCache`
and `CassandraSemanticCache`, similar in structure and functionality to
their Redis counterpart: providing a cache for the response to a
(prompt, llm) pair.

Integration tests are included. Moreover, linting and type checks are
all passing on my machine.

Dependencies: the `pyproject.toml` and `poetry.lock` have the newest
version of cassIO (the very same as in the Cassandra vector store
metadata PR, submitted as #9280).

If I may suggest, this issue and #9280 might be reviewed together (as
they bring the same poetry changes along), so I'm tagging @baskaryan who
already helped out a little with poetry-related conflicts there. (Thank
you!)

I'd be happy to add a short notebook if this is deemed necessary (but it
seems to me that, contrary e.g. to vector stores, caches are not covered
in specific notebooks).

Thank you!

---------

Co-authored-by: Harrison Chase <hw.chase.17@gmail.com>

2023-09-03 20:27:02 -07:00

..

experimental

adding new chain for logical fallacy removal from model output in chain (#9887)

2023-09-03 15:44:27 -07:00

langchain

Cassandra support for LLM cache (exact-match and semantic) (#9772)

2023-09-03 20:27:02 -07:00