baalajimaestro/llama.cpp
1
0
Fork 0
Code Issues Pull requests Packages Projects Releases Wiki Activity
849 commits 1 branch 0 tags 6 MiB
Commit graph

849 commits

This branch
This branch
All branches
Author SHA1 Message Date
dependabot[bot] 83f8438c4f
Bump fastapi from 0.100.1 to 0.101.0 
Bumps [fastapi](https://github.com/tiangolo/fastapi) from 0.100.1 to 0.101.0.
- [Release notes](https://github.com/tiangolo/fastapi/releases)
- [Commits](https://github.com/tiangolo/fastapi/compare/0.100.1...0.101.0)

---
updated-dependencies:
- dependency-name: fastapi
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-08-07 20:10:12 +00:00
Andrei 91bf8fac1b
Merge pull request #550 from abetlen/dependabot/pip/uvicorn-0.23.2 
Bump uvicorn from 0.23.1 to 0.23.2
 2023-08-01 17:39:25 -04:00
dependabot[bot] 0cc8d8282a
Bump uvicorn from 0.23.1 to 0.23.2 
Bumps [uvicorn](https://github.com/encode/uvicorn) from 0.23.1 to 0.23.2.
- [Release notes](https://github.com/encode/uvicorn/releases)
- [Changelog](https://github.com/encode/uvicorn/blob/master/CHANGELOG.md)
- [Commits](https://github.com/encode/uvicorn/compare/0.23.1...0.23.2)

---
updated-dependencies:
- dependency-name: uvicorn
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-08-01 21:25:18 +00:00
Andrei 5011ef4fc6
Merge pull request #549 from abetlen/dependabot/pip/mkdocs-material-9.1.21 
Bump mkdocs-material from 9.1.19 to 9.1.21
 2023-08-01 17:24:04 -04:00
Andrei 7fb4f0bda2
Merge pull request #548 from abetlen/dependabot/pip/fastapi-0.100.1 
Bump fastapi from 0.100.0 to 0.100.1
 2023-08-01 17:23:45 -04:00
dependabot[bot] ecb72cc0a2
Bump mkdocs-material from 9.1.19 to 9.1.21 
Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material) from 9.1.19 to 9.1.21.
- [Release notes](https://github.com/squidfunk/mkdocs-material/releases)
- [Changelog](https://github.com/squidfunk/mkdocs-material/blob/master/CHANGELOG)
- [Commits](https://github.com/squidfunk/mkdocs-material/compare/9.1.19...9.1.21)

---
updated-dependencies:
- dependency-name: mkdocs-material
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-07-31 20:32:04 +00:00
dependabot[bot] 4a2f41a803
Bump fastapi from 0.100.0 to 0.100.1 
Bumps [fastapi](https://github.com/tiangolo/fastapi) from 0.100.0 to 0.100.1.
- [Release notes](https://github.com/tiangolo/fastapi/releases)
- [Commits](https://github.com/tiangolo/fastapi/compare/0.100.0...0.100.1)

---
updated-dependencies:
- dependency-name: fastapi
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-07-31 20:31:16 +00:00
Andrei d89bf8c072
Merge pull request #536 from Isydmr/patch-2 
Fix OpenBLAS Docker build
 2023-07-28 01:37:23 -04:00
Ihsan Soydemir 3e77eea7ec
Fix OpenBLAS Docker build 
Current build produces the following:
`RuntimeError: Failed to load shared library '/usr/local/lib/python3.11/site-packages/llama_cpp/libllama.so': /usr/local/lib/python3.11/site-packages/llama_cpp/libllama.so: undefined symbol: cblas_sgemm`
 2023-07-27 19:44:15 +02:00
Andrei ffa81218f6
Merge pull request #531 from abetlen/dependabot/pip/uvicorn-0.23.1 
Bump uvicorn from 0.22.0 to 0.23.1
 2023-07-26 23:46:57 -04:00
dependabot[bot] 583d63351a
Bump uvicorn from 0.22.0 to 0.23.1 
Bumps [uvicorn](https://github.com/encode/uvicorn) from 0.22.0 to 0.23.1.
- [Release notes](https://github.com/encode/uvicorn/releases)
- [Changelog](https://github.com/encode/uvicorn/blob/master/CHANGELOG.md)
- [Commits](https://github.com/encode/uvicorn/compare/0.22.0...0.23.1)

---
updated-dependencies:
- dependency-name: uvicorn
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-07-27 03:33:07 +00:00
Andrei 468fccbed7
Merge pull request #532 from abetlen/dependabot/pip/black-23.7.0 
Bump black from 23.3.0 to 23.7.0
 2023-07-26 23:31:48 -04:00
dependabot[bot] ecdfe4fbd3
Bump black from 23.3.0 to 23.7.0 
Bumps [black](https://github.com/psf/black) from 23.3.0 to 23.7.0.
- [Release notes](https://github.com/psf/black/releases)
- [Changelog](https://github.com/psf/black/blob/main/CHANGES.md)
- [Commits](https://github.com/psf/black/compare/23.3.0...23.7.0)

---
updated-dependencies:
- dependency-name: black
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-07-26 19:08:28 +00:00
Andrei 6e6c275c94
Merge pull request #530 from abetlen/dependabot/pip/mkdocs-material-9.1.19 
Bump mkdocs-material from 9.1.18 to 9.1.19
 2023-07-26 15:07:21 -04:00
dependabot[bot] bfbbc8db14
Bump mkdocs-material from 9.1.18 to 9.1.19 
Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material) from 9.1.18 to 9.1.19.
- [Release notes](https://github.com/squidfunk/mkdocs-material/releases)
- [Changelog](https://github.com/squidfunk/mkdocs-material/blob/master/CHANGELOG)
- [Commits](https://github.com/squidfunk/mkdocs-material/compare/9.1.18...9.1.19)

---
updated-dependencies:
- dependency-name: mkdocs-material
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-07-26 17:54:39 +00:00
Andrei 7debb505ab
Merge pull request #516 from charles-dyfis-net/poetry-no-versions-in-extras 
pyproject.toml: extras list should contain only package list, not versions
 2023-07-26 13:53:48 -04:00
Andrei e665b557fd
Merge pull request #523 from shouyiwang/tensor_split 
Update tensor_split to match llama.cpp's change
 2023-07-26 13:53:02 -04:00
Andrei d3bf7db2db
Merge pull request #525 from Isydmr/patch-1 
Fix typo in model path
 2023-07-25 16:31:02 -04:00
Ihsan Soydemir 0687a3092b
Fix typo in 70B path 2023-07-25 20:49:44 +02:00
Shouyi Wang 426dbfe3f4 Change tensor_split from array to pointer 2023-07-25 18:29:59 +10:00
Andrei Betlen c7c700b0d4 Bump version 2023-07-24 14:11:21 -04:00
Andrei Betlen 11dd2bf382 Add temporary rms_norm_eps parameter 2023-07-24 14:09:24 -04:00
Andrei Betlen 8cd64d4ac3 Add rms_eps_norm 2023-07-24 13:52:12 -04:00
Andrei e4431a6ade
Merge pull request #522 from bretello/llama2-70b-support 
Llama2 70b support
 2023-07-24 13:48:26 -04:00
bretello 0f09f10e8c
add support for llama2 70b 2023-07-24 19:38:24 +02:00
Andrei Betlen 4aaaec561d Bump version 2023-07-24 13:12:38 -04:00
Andrei Betlen 401309d11c Revert "Merge pull request #521 from bretello/main" 
This reverts commit 07f0f3a386, reversing
changes made to d8a3ddbb1c.
 2023-07-24 13:11:10 -04:00
Andrei 07f0f3a386
Merge pull request #521 from bretello/main 
raise exception when `llama_load_model_from_file` fails
 2023-07-24 13:09:28 -04:00
Andrei Betlen d8a3ddbb1c Update llama.cpp 2023-07-24 13:08:06 -04:00
Andrei Betlen 985d559971 Update llama.cpp 2023-07-24 13:04:34 -04:00
bretello 8be7d67f7e
raise exception when llama_load_model_from_file fails 2023-07-24 14:42:37 +02:00
Charles Duffy c03fa87956
pyproject.toml: extras list should contain only package list, not versions (#515) 
Update poetry.lock accordingly.
 2023-07-23 13:15:40 -05:00
Andrei Betlen 231123ee1e Update llama.cpp 2023-07-21 12:41:59 -04:00
Andrei Betlen b83728ad1e Update llama.cpp 2023-07-21 12:33:27 -04:00
Andrei Betlen a4fe3fe350 Bump version 2023-07-20 18:56:29 -04:00
Andrei Betlen 01435da740 Update llama.cpp 2023-07-20 18:54:25 -04:00
Andrei Betlen 28a111704b Fix compatibility with older python versions 2023-07-20 18:52:10 -04:00
Andrei Betlen d10ce62714 Revert ctypes argtype change 2023-07-20 18:51:53 -04:00
Andrei 365d9a4367
Merge pull request #481 from c0sogi/main 
Added `RouteErrorHandler` for server
 2023-07-20 17:41:42 -04:00
Andrei a9cb645495
Merge pull request #511 from viniciusarruda/patch-1 
Update llama_cpp.py - Fix c_char_p to Array[c_char_p] and c_float to …
 2023-07-20 17:40:39 -04:00
Vinicius a8551477f5
Update llama_cpp.py - Fix c_char_p to Array[c_char_p] and c_float to Array[c_float] 2023-07-20 17:29:11 -03:00
Andrei 5549a1cabd
Merge pull request #508 from ctejada85/main 
Now the last token sent when `stream=True`
 2023-07-20 16:07:54 -04:00
Carlos Tejada 0756a2d3fb Now the last token sent when stream=True 2023-07-19 22:47:14 -04:00
Andrei 36872620d0
Merge pull request #501 from a10y/patch-1 
Update install instructions for Linux OpenBLAS
 2023-07-18 22:26:42 -04:00
Andrew Duffy b6b2071180
Update install instructions for Linux OpenBLAS 
The instructions are different than they used to be.

Source: https://github.com/ggerganov/llama.cpp#openblas
 2023-07-18 22:22:33 -04:00
Andrei a05cfaf815
Merge pull request #498 from ctejada85/windows-pip-install 
Added info to set ENV variables in PowerShell
 2023-07-18 18:53:24 -04:00
Carlos Tejada b24b10effd Added info to set ENV variables in PowerShell 
- Added an example on how to set the variables `CMAKE_ARGS`
  and `FORCE_CMAKE`.
- Added a subtitle for the `Windows remarks` and `MacOS` remarks.
 2023-07-18 17:14:42 -04:00
Andrei Betlen c9985abc03 Bump version 2023-07-18 13:54:51 -04:00
Andrei Betlen 9127bc2777 Update llama.cpp 2023-07-18 13:54:42 -04:00
Andrei 071ac799d5
Merge pull request #485 from callMeMakerRen/main 
expose RoPE param to server start
 2023-07-18 12:30:21 -04:00