jdelony/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-06-27 23:50:20 -05:00
Code Issues Packages Projects Releases Wiki Activity
llama.cpp/tools
History
Reguna 40f3aafc45
server: add "X-Accel-Buffering": "no" header to streaming endpoints (#24774) 
* server: add "X-Accel-Buffering": "no" header to streaming endpoints

This header tells Nginx (as a reverse proxy) to NOT buffer responses. (only affects streaming endpoints)
Without it, Nginx will break streaming with certain applications (notably the Pi coding harness).
2026-06-18 22:01:24 +02:00
..
batched-bench
cmake : add install() for impl libraries + fix apple builds (#23511)
2026-05-22 11:46:26 +03:00
cli
cli : fix not copying preserved tokens (#24258)
2026-06-14 11:52:15 +02:00
completion
completion : remove useless statics (#24226)
2026-06-06 12:16:16 +02:00
cvector-generator
libs : rename libcommon -> libllama-common (#21936)
2026-04-17 11:11:46 +03:00
export-lora
docs: fix export-lora --lora-scaled syntax [no release] (#24703)
2026-06-18 16:46:17 +02:00
fit-params
cmake : add install() for impl libraries + fix apple builds (#23511)
2026-05-22 11:46:26 +03:00
gguf-split
libs : rename libcommon -> libllama-common (#21936)
2026-04-17 11:11:46 +03:00
imatrix
Move duplicated imatrix code into single common imatrix-loader.cpp (#22445)
2026-06-04 17:45:40 +02:00
llama-bench
bench : add --offline (#24511)
2026-06-16 08:26:05 +02:00
mtmd
mtmd: add batching for mtmd-cli, add video tests (#24778)
2026-06-18 21:55:04 +02:00
parser
libs : rename libcommon -> libllama-common (#21936)
2026-04-17 11:11:46 +03:00
perplexity
perplexity : fix format specifier in LOG_ERR (#23788)
2026-05-28 10:34:58 +03:00
quantize
docs: Update quantization readme (#24133)
2026-06-05 12:21:26 +02:00
results
libs : rename libcommon -> libllama-common (#21936)
2026-04-17 11:11:46 +03:00
rpc
fix: rpc-server cache may not work in Windows environments (#22394)
2026-04-27 17:25:09 +03:00
server
server: add "X-Accel-Buffering": "no" header to streaming endpoints (#24774)
2026-06-18 22:01:24 +02:00
tokenize
libs : rename libcommon -> libllama-common (#21936)
2026-04-17 11:11:46 +03:00
tts
logs : reduce (#23021)
2026-05-14 13:05:52 +03:00
ui
ui: provide touch accessible model selection UI (#24604)
2026-06-18 13:14:20 +02:00
CMakeLists.txt
cmake: skip cvector-generator and export-lora when CPU backend is disabled (#24053)
2026-06-04 13:13:19 +03:00