Commit graph

1223 commits

Author SHA1 Message Date
Andrei Betlen d29b05bb67 Update example to match alpaca training prompt 2023-03-24 14:34:15 -04:00
Andrei Betlen e24c581b5a Implement prompt batch processing as in main.cpp 2023-03-24 14:33:38 -04:00
Andrei Betlen a28cb92d8f Remove model_name param 2023-03-24 04:04:29 -04:00
Andrei Betlen 15e3dc7897 Add fastapi example 2023-03-24 01:41:24 -04:00
Andrei Betlen 281b5cfa6b Update README.md 2023-03-24 00:06:24 -04:00
Andrei Betlen 27a5649cde Update README.md 2023-03-23 23:55:42 -04:00
Andrei Betlen 9af16b63fd Added low-level api inference example 2023-03-23 23:45:59 -04:00
Andrei Betlen 327365149e Bump Version 2023-03-23 23:13:08 -04:00
Andrei Betlen 8680332203 Update examples 2023-03-23 23:12:42 -04:00
Andrei Betlen 2c25257c62 Update llama.cpp 2023-03-23 23:00:56 -04:00
Andrei Betlen 02760f8fa7 Update llama.cpp and shared library build process 2023-03-23 17:01:06 -04:00
Andrei Betlen 90c78723de Add basic langchain demo 2023-03-23 16:25:24 -04:00
Andrei Betlen eec9256a42 Bugfix: avoid decoding partial utf-8 characters 2023-03-23 16:25:13 -04:00
Andrei Betlen 6c596f4f5a Update README 2023-03-23 16:00:10 -04:00
Andrei Betlen 73757a31ae Version bump 2023-03-23 16:00:02 -04:00
Andrei Betlen e63ea4dbbc Add support for logprobs 2023-03-23 15:51:05 -04:00
Andrei Betlen 3d6eb32c76 Update basic example 2023-03-23 14:57:31 -04:00
Andrei Betlen dba6df282d Update repo url 2023-03-23 14:57:18 -04:00
Andrei Betlen e34edfa7c7 Update pip instructions in readme 2023-03-23 14:24:34 -04:00
Andrei Betlen 93f074a4fa Initial pypi release 2023-03-23 14:24:08 -04:00
Andrei Betlen 465238b179 Updated package to build with skbuild 2023-03-23 13:54:14 -04:00
Andrei Betlen 5bd6efb18a Add llama.cpp to vendor folder 2023-03-23 05:37:26 -04:00
Andrei Betlen 79b304c9d4 Initial commit 2023-03-23 05:33:06 -04:00