baalajimaestro/llama.cpp
1
0
Fork 0
Code Issues Pull requests Packages Projects Releases Wiki Activity

Merge pull request #525 from Isydmr/patch-1

Browse source 
Fix typo in model path
This commit is contained in:
Andrei 2023-07-25 16:31:02 -04:00 committed by GitHub
parent c7c700b0d4 0687a3092b
commit d3bf7db2db
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
README.md
View file

@ -140,7 +140,7 @@ llm = Llama(model_path="./models/7B/ggml-model.bin", n_ctx=2048)
Llama2 70b must set the `n_gqa` parameter (grouped-query attention factor) to 8 when loading:
```python
llm = Llama(model_path="./models/7B/ggml-model.bin", n_gqa=8)
llm = Llama(model_path="./models/70B/ggml-model.bin", n_gqa=8)
```
## Web Server