From 01ab758df9cf73255d6cad9b6e2d56226acdabe5 Mon Sep 17 00:00:00 2001 From: AT Date: Thu, 20 Apr 2023 18:56:38 -0400 Subject: [PATCH] Update README.md --- README.md | 14 ++++++++++++-- 1 file changed, 12 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index 10ded11d..18891a54 100644 --- a/README.md +++ b/README.md @@ -40,14 +40,24 @@ GPT-J model by following build instructions below. * Download https://huggingface.co/EleutherAI/gpt-j-6b * Clone this repo and build ``` -git clone --recurse-submodules https://github.com/nomic-ai/gpt4all-chat -cd gpt4all-chat +git clone https://github.com/ggerganov/ggml.git +cd ggml mkdir build cd build cmake .. cmake --build . --parallel python3 ../ggml/examples/gpt-j/convert-h5-to-ggml.py /path/to/your/local/copy/of/EleutherAI/gpt-j-6B 0 ./bin/gpt-j-quantize /path/to/your/local/copy/of/EleutherAI/gpt-j-6B/ggml-model-f32.bin ./ggml-model-q4_0.bin 2 +``` +and then +``` +git clone --recurse-submodules https://github.com/nomic-ai/gpt4all-chat +cd gpt4all-chat +mkdir build +cd build +cmake .. +cmake --build . --parallel +mv /path/to/ggml-model-q4_0.bin . ./chat ```