llama.cpp/llama_cpp/server
Brandon Roberts 62944df142
Bugfix: Remove f16_kv, add offload_kqv field (#1019)
F16_KV appears to have been removed here: af99c6fbfc

This addresses two issues:

 - #995 which just requests to add the KV cache offloading param
 - #1006 a NULL ptr exception when using the embeddings (introduced by
   leaving f16_kv in the fields struct)
2023-12-18 14:27:11 -05:00
..
__init__.py llama_cpp server: app is now importable, still runnable as a module 2023-04-29 11:41:25 -07:00
__main__.py Add support for running the server with SSL (#994) 2023-12-11 20:47:11 -05:00
app.py Bugfix: Remove f16_kv, add offload_kqv field (#1019) 2023-12-18 14:27:11 -05:00