3 Commits

Author	SHA1	Message	Date
Harrison Chase	3474f39e21	Harrison/improve cache (#368) ... make it so everything goes through generate, which removes the need for two types of caches	2022-12-18 16:22:42 -05:00
mrbean	fe6695b9e7	Add HuggingFacePipeline LLM (#353) ... https://github.com/hwchase17/langchain/issues/354 Add support for running your own HF pipeline locally. This would allow you to get a lot more dynamic with what HF features and models you support since you wouldn't be beholden to what is hosted in HF hub. You could also do stuff with HF Optimum to quantize your models and stuff to get pretty fast inference even running on a laptop.	2022-12-17 07:00:04 -08:00
Harrison Chase	9bb7195085	Harrison/llm saving (#331) ... Co-authored-by: Akash Samant <70665700+asamant21@users.noreply.github.com>	2022-12-13 06:46:01 -08:00