LLaMA2 with JSON schema support template (#12435)

This commit is contained in:
Lance Martin
2023-10-27 10:34:00 -07:00
committed by GitHub
parent 134f085824
commit 05bbf943f2
8 changed files with 1359 additions and 1 deletions

View File

@@ -0,0 +1,13 @@
# Extraction with LLaMA2 Function Calling
This template shows how to do extraction of structured data from unstructured data, using LLaMA2 [fine-tuned for grammars and jsonschema](https://replicate.com/andreasjansson/llama-2-13b-chat-gguf).
Specify the scehma you want to extract in `chain.py`
By default, it will extract the title and author of papers.
## LLM
This template will use `Replicate` [hosted version](https://replicate.com/andreasjansson/llama-2-13b-chat-gguf) of LLaMA.
Be sure that `REPLICATE_API_TOKEN` is set in your environment.