Xuan-Son Nguyen 61bdfd5298

server : implement prompt processing progress report in stream mode (#15827) ...

* server : implement `return_progress`

* add timings.cache_n

* add progress.time_ms

* add test

* fix test for chat/completions

* readme: add docs on timings

* use ggml_time_us

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

2025-09-06 13:35:04 +02:00

..

batched-bench

llama: use FA + max. GPU layers by default (#15434)

2025-08-30 16:32:10 +02:00

cvector-generator

llama : deprecate llama_kv_self_ API (#14030)

2025-06-06 14:11:15 +03:00

export-lora

mtmd : fix 32-bit narrowing issue in export-lora and mtmd clip (#14503)

2025-07-25 13:08:04 +02:00

gguf-split

scripts : make the shell scripts cross-platform (#14341)

2025-06-30 10:17:18 +02:00

imatrix

imatrix : warn when GGUF imatrix is saved without .gguf suffix (#15076)

2025-08-04 23:26:52 +02:00

llama-bench

llama: use FA + max. GPU layers by default (#15434)

2025-08-30 16:32:10 +02:00

main

cli : change log to warning to explain reason for stopping (#15604)

2025-08-28 10:48:20 +03:00

mtmd

mtmd : fix mtmd ios build (#15579)

2025-08-26 20:05:50 +02:00

perplexity

perplexity: give more information about constraints on failure (#15303)

2025-08-14 09:16:32 +03:00

quantize

llama : add gpt-oss (#15091)

2025-08-05 22:10:36 +03:00

rpc

rpc : Fix build on OpenBSD (#13541)

2025-05-25 15:35:53 +03:00

run

cmake : do not search for curl libraries by ourselves (#14613)

2025-07-10 15:29:05 +03:00

server

server : implement prompt processing progress report in stream mode (#15827)

2025-09-06 13:35:04 +02:00

tokenize

llama : move end-user examples to tools directory (#13249)

2025-05-02 20:27:13 +02:00

tts

sampling : optimize samplers by reusing bucket sort (#15665)

2025-08-31 20:41:02 +03:00

CMakeLists.txt

mtmd : rename llava directory to mtmd (#13311)

2025-05-05 16:02:55 +02:00