Commit graph

26 commits

Author SHA1 Message Date
ZisisTsatsas f3117c0cf6
fix: openblas_simple missing pkg-config to build (#920) 2023-11-20 12:31:02 -05:00
Andrei Betlen 2291798900 Fix dockerfiles to install starlette-context 2023-09-14 14:40:16 -04:00
Andrei Betlen 1dd3f473c0 Remove references to FORCE_CMAKE 2023-09-12 19:01:16 -04:00
Andrei Betlen ac47d55577 Merge branch 'main' into v0.2-wip 2023-08-25 15:45:22 -04:00
Andrei Betlen cf405f6764 Merge branch 'main' into v0.2-wip 2023-08-24 00:30:51 -04:00
Andrei 876f39d751
Merge pull request #564 from Isydmr/main
Docker improvements
2023-08-17 23:21:27 -04:00
Pradyumna Singh Rathore d010ea70d2
Fixed Cuda Dockerfile
Previously models produced garbage output when running on GPU with layers offloaded.

Similar to related fix on another repo: 331326a0e3
2023-08-10 20:41:34 +05:30
Ihsan Soydemir a5bc57e279
Update README.md 2023-08-03 16:49:45 +02:00
Ihsan Soydemir cdab73536b
Docker improvements 2023-08-03 16:36:50 +02:00
Ihsan Soydemir 3e77eea7ec
Fix OpenBLAS Docker build
Current build produces the following:
`RuntimeError: Failed to load shared library '/usr/local/lib/python3.11/site-packages/llama_cpp/libllama.so': /usr/local/lib/python3.11/site-packages/llama_cpp/libllama.so: undefined symbol: cblas_sgemm`
2023-07-27 19:44:15 +02:00
Andrei Betlen 6cb77a20c6 Migrate to scikit-build-core. Closes #489 2023-07-18 18:52:29 -04:00
Andrei Betlen 99f064e681 docker: Add libopenblas to simple image 2023-07-09 01:36:39 -04:00
Andrei Betlen 52753b77f5 Upgrade fastapi to 0.100.0 and pydantic v2 2023-07-07 21:38:46 -04:00
Andrei Betlen ca11673061 Add universal docker image 2023-07-07 03:38:51 -04:00
Gary Mulder 30d32e996b More README.md corrections and cleanup 2023-06-02 11:08:59 +00:00
Gary Mulder d4eef735d9 Fixed .gitignore to ignore any downloaded model .bin files. Cleaned up README.md again 2023-06-02 11:03:19 +00:00
Gary Mulder f24e7a7e52 Updated instructions 2023-06-02 10:44:52 +00:00
Gary Mulder cf4931a400 Working Open Llama 3B in a box 2023-06-02 08:48:54 +00:00
Gary Mulder 217d78320f Added paramterised search and d/l for Hugging Face. Updated README.md 2023-05-31 16:00:31 +00:00
Gary Mulder 483b6ba53a Updated README.md instructions on how to use *_simple/Dockerfiles 2023-05-31 15:16:32 +00:00
Gary Mulder 0e0c9bb978 Merge branch 'auto-docker' of github.com:gjmulder/llama-cpp-python-gary into auto-docker 2023-05-25 11:50:34 +00:00
Gary Mulder 0d2cc21202 Fixed repeated imports 2023-05-25 11:50:02 +00:00
Gary Mulder ec44bdad61
Update README.md 2023-05-23 20:50:39 +01:00
Gary Mulder ed19071ef8 Renamed and moved old Dockerfiles 2023-05-23 19:38:37 +00:00
Gary Mulder 70f629a72f
Update README.md 2023-05-23 20:36:21 +01:00
Gary Mulder eaff7a8678 Initial commit of auto docker 2023-05-23 19:26:40 +00:00