From 37d5192a92a9e3a861027af03dab7a792436fad7 Mon Sep 17 00:00:00 2001 From: Andrei Betlen Date: Fri, 16 Jun 2023 10:41:51 -0400 Subject: [PATCH] Update docs --- docs/macos_install.md | 7 ++----- 1 file changed, 2 insertions(+), 5 deletions(-) diff --git a/docs/macos_install.md b/docs/macos_install.md index 7d46bc4..33dcb5d 100644 --- a/docs/macos_install.md +++ b/docs/macos_install.md @@ -38,14 +38,11 @@ llama-cpp-python         0.1.62      ``` -**(4) Download a v3 ggml llama/vicuna/alpaca model** +**(4) Download a v3 ggml model** - **ggmlv3** - file name ends with **q4_0.bin** - indicating it is 4bit quantized, with quantisation method 0 -https://huggingface.co/vicuna/ggml-vicuna-13b-1.1/blob/main/ggml-vic13b-q4_0.bin -https://huggingface.co/vicuna/ggml-vicuna-13b-1.1/blob/main/ggml-vic13b-uncensored-q4_0.bin -https://huggingface.co/TheBloke/LLaMa-7B-GGML/blob/main/llama-7b.ggmlv3.q4_0.bin -https://huggingface.co/TheBloke/LLaMa-13B-GGML/blob/main/llama-13b.ggmlv3.q4_0.bin +https://huggingface.co/TheBloke/open-llama-7b-open-instruct-GGML **(6) run the llama-cpp-python API server with MacOS Metal GPU support**