eryk-dsai 7f5713b80a feat: grammar-based sampling in llama-cpp (#9712) ... ## Description The following PR enables the [grammar-based sampling](https://github.com/ggerganov/llama.cpp/tree/master/grammars) in llama-cpp LLM. In short, loading file with formal grammar definition will constrain model outputs. For instance, one can force the model to generate valid JSON or generate only python lists. In the follow-up PR we will add: * docs with some description why it is cool and how it works * maybe some code sample for some task such as in llama repo --------- Co-authored-by: Lance Martin <lance@langchain.dev> Co-authored-by: Bagatur <baskaryan@gmail.com>		2023-08-28 09:52:55 -07:00
..
experimental	Initial commit for comprehend moderator (#9665)	2023-08-25 15:11:27 -07:00
langchain	feat: grammar-based sampling in llama-cpp (#9712)	2023-08-28 09:52:55 -07:00