diff --git a/README.md b/README.md index 1cf92d2c..2511c1aa 100644 --- a/README.md +++ b/README.md @@ -13,10 +13,11 @@ GPT-J model. * The UI is made to look and feel like you've come to expect from a chatty gpt * Easy to install... The plan is to create precompiled binaries for major platforms with easy installer including model -## Building +## Building and running * Install Qt 6.x for your platform https://doc.qt.io/qt-6/get-and-install-qt.html * Install cmake for your platform https://cmake.org/install/ +* Download https://huggingface.co/EleutherAI/gpt-j-6b * Clone this repo and build ``` git clone --recurse-submodules https://github.com/manyoso/gpt4all-chat.git @@ -25,12 +26,11 @@ mkdir build cd build cmake .. cmake --build . --parallel +python3 ../ggml/examples/gpt-j/convert-h5-to-ggml.py /path/to/your/local/copy/of/EleutherAI/gpt-j-6B 0 +./bin/gpt-j-quantize /path/to/your/local/copy/of/EleutherAI/gpt-j-6B/ggml-model-f32.bin ./ggml-model-q4_0.bin 2 +./chat ``` -## Running - -* Simply place the appropriate model file named ```ggml-model-q4_0.bin``` in the same directory as the exe produced above and start the exe - ## Contributing * Pull requests welcome :)