Add invoke example to LLaMA2 function template notebook (#12437)

This commit is contained in:
Lance Martin
2023-10-27 10:58:24 -07:00
committed by GitHub
parent 0ca539eb85
commit 68e12d34a9
2 changed files with 7 additions and 2 deletions

View File

@@ -8,6 +8,8 @@ By default, it will extract the title and author of papers.
## LLM
This template will use `Replicate` [hosted version](https://replicate.com/andreasjansson/llama-2-13b-chat-gguf) of LLaMA.
This template will use a `Replicate` [hosted version](https://replicate.com/andreasjansson/llama-2-13b-chat-gguf) of LLaMA2 that has support for grammars and jsonschema.
Based on the `Replicate` example, these are supplied directly in the prompt.
Be sure that `REPLICATE_API_TOKEN` is set in your environment.