dmaivel 4f4bcfbe67

Add --defer-experts flag to defer expert mmap residency on Linux (#1634) ...

* Add --defer-experts flag to defer expert mmap residency on Linux

* Disable warmup when defer-experts is enabled

2026-04-16 08:54:44 +02:00

..

cmake

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

jinja

common : introduce composable PEG parser combinators for chat parsing and new jinja template engine (#1369)

2026-03-09 11:03:33 +01:00

base64.hpp

llava : expose as a shared library for downstream projects (#3613)

2023-11-07 00:36:23 +03:00

build-info.cpp.in

build : link against build info instead of compiling against it (#3879)

2023-11-02 08:50:16 +02:00

chat-parser-xml-toolcall.cpp

common : introduce composable PEG parser combinators for chat parsing and new jinja template engine (#1369)

2026-03-09 11:03:33 +01:00

chat-parser-xml-toolcall.h

Allow arbitrary arguments order for Q3C, Q3CN, and Qwen3.5 (#1352)

2026-03-03 15:39:16 +01:00

chat-parser.cpp

common : introduce composable PEG parser combinators for chat parsing and new jinja template engine (#1369)

2026-03-09 11:03:33 +01:00

chat-parser.h

Refactor chat and server file (#1062)

2025-12-15 08:27:20 +01:00

chat-peg-parser.cpp

common : introduce composable PEG parser combinators for chat parsing and new jinja template engine (#1369)

2026-03-09 11:03:33 +01:00

chat-peg-parser.h

common : introduce composable PEG parser combinators for chat parsing and new jinja template engine (#1369)

2026-03-09 11:03:33 +01:00

chat.cpp

Fix jinja (#1518)

2026-03-26 17:24:11 +01:00

chat.h

fix grammar stack empty error for qwen3.5 (#1490)

2026-03-24 07:48:20 +01:00

CMakeLists.txt

Allow tuning of the best args for speculative decoding. (#1595)

2026-04-08 08:02:42 +02:00

common.cpp

Add --defer-experts flag to defer expert mmap residency on Linux (#1634)

2026-04-16 08:54:44 +02:00

common.h

Add --defer-experts flag to defer expert mmap residency on Linux (#1634)

2026-04-16 08:54:44 +02:00

console.cpp

check C++ code with -Wmissing-declarations (#3184)

2023-09-15 15:38:27 -04:00

console.h

gguf : new file format with flexible meta data (beta) (#2398)

2023-08-21 23:07:43 +03:00

json-partial.cpp

common : introduce composable PEG parser combinators for chat parsing and new jinja template engine (#1369)

2026-03-09 11:03:33 +01:00

json-partial.h

Move minja and nlohmann/json to vendor (#802)

2025-09-27 09:12:35 +02:00

json-schema-to-grammar.cpp

common : introduce composable PEG parser combinators for chat parsing and new jinja template engine (#1369)

2026-03-09 11:03:33 +01:00

json-schema-to-grammar.h

common : introduce composable PEG parser combinators for chat parsing and new jinja template engine (#1369)

2026-03-09 11:03:33 +01:00

llguidance.cpp

Tool calls support from mainline (#723)

2025-09-01 08:38:49 +03:00

log.cpp

Refactor chat and server file (#1062)

2025-12-15 08:27:20 +01:00

log.h

Server: refactor and rename functions (#1151)

2026-01-18 08:16:57 +02:00

ngram-cache.cpp

spec : add self speculative decoding, ngram and refactor (#1261)

2026-02-13 19:04:55 +01:00

ngram-cache.h

spec : add self speculative decoding, ngram and refactor (#1261)

2026-02-13 19:04:55 +01:00

ngram-map.cpp

spec : add self speculative decoding, ngram and refactor (#1261)

2026-02-13 19:04:55 +01:00

ngram-map.h

spec : add self speculative decoding, ngram and refactor (#1261)

2026-02-13 19:04:55 +01:00

ngram-mod.cpp

spec : add self speculative decoding, ngram and refactor (#1261)

2026-02-13 19:04:55 +01:00

ngram-mod.h

spec : add self speculative decoding, ngram and refactor (#1261)

2026-02-13 19:04:55 +01:00

peg-parser.cpp

common : introduce composable PEG parser combinators for chat parsing and new jinja template engine (#1369)

2026-03-09 11:03:33 +01:00

peg-parser.h

common : introduce composable PEG parser combinators for chat parsing and new jinja template engine (#1369)

2026-03-09 11:03:33 +01:00

regex-partial.cpp

server : support multi-modal context checkpoints and prompt caching (#1398)

2026-03-13 08:07:57 +01:00

regex-partial.h

Tool calls support from mainline (#723)

2025-09-01 08:38:49 +03:00

sampling.cpp

Add Unicode allowlist (#1597)

2026-04-10 18:22:57 +02:00

sampling.h

Add Unicode allowlist (#1597)

2026-04-10 18:22:57 +02:00

spec-tuner.cpp

Allow tuning of the best args for speculative decoding. (#1595)

2026-04-08 08:02:42 +02:00

spec-tuner.h

Allow tuning of the best args for speculative decoding. (#1595)

2026-04-08 08:02:42 +02:00

speculative.cpp

Add support for parallel graphs to GLM MTP (#1637)

2026-04-16 08:05:34 +02:00

speculative.h

Add llama_context to MTP (#1601)

2026-04-09 15:33:56 +02:00

train.cpp

Server: refactor and rename functions (#1151)

2026-01-18 08:16:57 +02:00

train.h

sync : ggml (backend v2) (#3912)

2023-11-13 14:16:23 +02:00

unicode.cpp

common : introduce composable PEG parser combinators for chat parsing and new jinja template engine (#1369)

2026-03-09 11:03:33 +01:00

unicode.h

common : introduce composable PEG parser combinators for chat parsing and new jinja template engine (#1369)

2026-03-09 11:03:33 +01:00