Kawrakow f5e5753c32

Fix Qwen35 mtp warmup (#1987) ...

* Use hidden state from prev token from qwen mtp

* Fix Qwen35 MTP warmup

* Cleanup + remove unnecessary crippling performance by not using accept to sample draft token

* Provide API to gtet the model arch string

---------

Co-authored-by: SamuelOliveirads <samueloliveira32df@gmail.com>

2026-06-18 09:03:40 +02:00

..

graphs

Fix DFlash on the CPU

2026-06-16 13:22:36 +00:00

CMakeLists.txt

Merge pull request #1970 from SamuelOliveirads/feat/dflash-implementation

2026-06-16 15:07:55 +02:00

llama-arch.cpp

Fix Qwen35 mtp warmup (#1987)

2026-06-18 09:03:40 +02:00

llama-arch.h

Merge pull request #1970 from SamuelOliveirads/feat/dflash-implementation

2026-06-16 15:07:55 +02:00

llama-build-context.cpp

Merge pull request #1970 from SamuelOliveirads/feat/dflash-implementation

2026-06-16 15:07:55 +02:00

llama-build-context.h

Merge pull request #1970 from SamuelOliveirads/feat/dflash-implementation

2026-06-16 15:07:55 +02:00

llama-context.h

clean logs

2026-06-14 21:07:57 -03:00

llama-cparams.h

MLA tensor parallelism under -sm graph (DEEPSEEK2/GLM_DSA/MISTRAL4) (#1821)

2026-05-19 08:36:17 +03:00

llama-delta-net.cpp

MTP: faster recurrent state restore (#1791)

2026-05-13 11:00:24 +03:00

llama-delta-net.h

MTP: faster recurrent state restore (#1791)

2026-05-13 11:00:24 +03:00

llama-dflash.cpp

minor refactor in DFlash kv cache graph

2026-06-15 18:22:56 -03:00

llama-dflash.h

move dflash for it own file

2026-06-02 10:22:13 -03:00

llama-expert-io.h

Add --defer-experts flag to defer expert mmap residency on Linux (#1634)

2026-04-16 08:54:44 +02:00

llama-grammar.cpp

Bug fixes (#1940)

2026-06-10 07:45:49 +02:00

llama-grammar.h

llama : add token matching support to llama-grammar (#1220)

2026-02-03 07:57:17 +02:00

llama-hparams.cpp

Merge pull request #1970 from SamuelOliveirads/feat/dflash-implementation

2026-06-16 15:07:55 +02:00

llama-hparams.h

Merge remote-tracking branch 'origin/main' into feat/dflash-implementation

2026-06-13 17:27:52 -03:00

llama-impl.h

Full graph parallel for Qwen3.5 (dense and MoE) (#1388)

2026-03-10 09:08:24 +01:00

llama-load-tensors.cpp

Merge pull request #1970 from SamuelOliveirads/feat/dflash-implementation

2026-06-16 15:07:55 +02:00

llama-mmap.cpp

Add --defer-experts flag to defer expert mmap residency on Linux (#1634)

2026-04-16 08:54:44 +02:00

llama-mmap.h

Add --defer-experts flag to defer expert mmap residency on Linux (#1634)

2026-04-16 08:54:44 +02:00

llama-model-loader.cpp

fix: use int8_t for GGUF bool array loading instead of platform-dependent bool (#1648)

2026-04-17 07:25:07 +02:00

llama-model-loader.h

MTP: option to use re-quantized output tensor for better TG performance (#1809)

2026-05-16 14:40:18 +03:00

llama-model.cpp

Merge pull request #1970 from SamuelOliveirads/feat/dflash-implementation

2026-06-16 15:07:55 +02:00

llama-model.h

Merge remote-tracking branch 'origin/main' into feat/dflash-implementation

2026-06-13 17:27:52 -03:00

llama-quantize.cpp

Merge remote-tracking branch 'origin/main' into feat/dflash-implementation

2026-06-13 17:27:52 -03:00

llama-quantize.h

Allow using -rtr and -muge together (#1444)

2026-03-16 18:26:26 +01:00

llama-sampling.cpp

Bug fixes (#1940)

2026-06-10 07:45:49 +02:00

llama-sampling.h

Add adaptive sampling clone and free functions to manage memory (#1851)

2026-05-21 08:11:17 +03:00

llama-spec-features-dflash.cpp

Fix DFlash oerformance with split mode graph (#1980)

2026-06-17 18:40:02 +02:00

llama-spec-features-dflash.h

clean logs

2026-06-14 21:07:57 -03:00

llama-spec-features.cpp

remove duplicated code and unnecesary refactor

2026-06-14 16:02:02 -03:00

llama-spec-features.h

move dflash for it own file

2026-06-02 10:22:13 -03:00

llama-vocab.cpp

model: add Cohere2-MoE North Mini Code support (#1945)

2026-06-10 15:28:27 +02:00

llama-vocab.h

Add Mellum2 architecture support (#1919)

2026-06-04 14:28:02 +02:00

llama.cpp

Fix (Gemma-4 Vision): Correct KQ mask fill for causal models in non-causal flash-attn mode (#1985)

2026-06-17 16:52:45 +02:00

unicode-data.cpp

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

unicode-data.h

Merge mainline llama.cpp (#3)

2024-07-27 07:55:01 +02:00

unicode-script-data.cpp

Add Unicode allowlist (#1597)

2026-04-10 18:22:57 +02:00

unicode.cpp

Gemma4 tokenizer fixes (#1603)

2026-04-09 15:33:28 +02:00

unicode.h

Add Unicode allowlist (#1597)

2026-04-10 18:22:57 +02:00