Commit graph

1288 commits

Author SHA1 Message Date
Andrei Betlen 206efa39df Bump version 2023-03-25 12:12:39 -04:00
Andrei Betlen fa92740a10 Update llama.cpp 2023-03-25 12:12:09 -04:00
Andrei Betlen dfe8608096 Update examples 2023-03-24 19:10:31 -04:00
Andrei Betlen 5533ed7aa8 Update docs 2023-03-24 19:02:36 -04:00
Andrei Betlen cbf8a62b64 Add repo url 2023-03-24 18:59:02 -04:00
Andrei Betlen df15caa877 Add mkdocs 2023-03-24 18:57:59 -04:00
Andrei Betlen a61fd3b509 Add example based on stripped down version of main.cpp from llama.cpp 2023-03-24 18:57:25 -04:00
Andrei Betlen da9b71cfe5 Bump version 2023-03-24 18:44:04 -04:00
Andrei Betlen 4da5faa28b Bugfix: cross-platform method to find shared lib 2023-03-24 18:43:29 -04:00
Andrei Betlen b93675608a Handle errors returned by llama.cpp 2023-03-24 15:47:17 -04:00
Andrei Betlen bcde1f19b7 Bump version 2023-03-24 15:00:10 -04:00
Andrei Betlen 7786edb0f9 Black formatting 2023-03-24 14:59:29 -04:00
Andrei Betlen c784d83131 Update llama.cpp and re-organize low-level api 2023-03-24 14:58:42 -04:00
Andrei Betlen b9c53b88a1 Use n_ctx provided from actual context not params 2023-03-24 14:58:10 -04:00
Andrei Betlen 2cc499512c Black formatting 2023-03-24 14:35:41 -04:00
Andrei Betlen d29b05bb67 Update example to match alpaca training prompt 2023-03-24 14:34:15 -04:00
Andrei Betlen e24c581b5a Implement prompt batch processing as in main.cpp 2023-03-24 14:33:38 -04:00
Andrei Betlen a28cb92d8f Remove model_name param 2023-03-24 04:04:29 -04:00
Andrei Betlen 15e3dc7897 Add fastapi example 2023-03-24 01:41:24 -04:00
Andrei Betlen 281b5cfa6b Update README.md 2023-03-24 00:06:24 -04:00
Andrei Betlen 27a5649cde Update README.md 2023-03-23 23:55:42 -04:00
Andrei Betlen 9af16b63fd Added low-level api inference example 2023-03-23 23:45:59 -04:00
Andrei Betlen 327365149e Bump Version 2023-03-23 23:13:08 -04:00
Andrei Betlen 8680332203 Update examples 2023-03-23 23:12:42 -04:00
Andrei Betlen 2c25257c62 Update llama.cpp 2023-03-23 23:00:56 -04:00
Andrei Betlen 02760f8fa7 Update llama.cpp and shared library build process 2023-03-23 17:01:06 -04:00
Andrei Betlen 90c78723de Add basic langchain demo 2023-03-23 16:25:24 -04:00
Andrei Betlen eec9256a42 Bugfix: avoid decoding partial utf-8 characters 2023-03-23 16:25:13 -04:00
Andrei Betlen 6c596f4f5a Update README 2023-03-23 16:00:10 -04:00
Andrei Betlen 73757a31ae Version bump 2023-03-23 16:00:02 -04:00
Andrei Betlen e63ea4dbbc Add support for logprobs 2023-03-23 15:51:05 -04:00
Andrei Betlen 3d6eb32c76 Update basic example 2023-03-23 14:57:31 -04:00
Andrei Betlen dba6df282d Update repo url 2023-03-23 14:57:18 -04:00
Andrei Betlen e34edfa7c7 Update pip instructions in readme 2023-03-23 14:24:34 -04:00
Andrei Betlen 93f074a4fa Initial pypi release 2023-03-23 14:24:08 -04:00
Andrei Betlen 465238b179 Updated package to build with skbuild 2023-03-23 13:54:14 -04:00
Andrei Betlen 5bd6efb18a Add llama.cpp to vendor folder 2023-03-23 05:37:26 -04:00
Andrei Betlen 79b304c9d4 Initial commit 2023-03-23 05:33:06 -04:00