jdelony/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-07-01 00:10:21 -05:00
Code Issues Packages Projects Releases Wiki Activity
llama.cpp/src/models
History
Xuan-Son Nguyen 506bb6e010
model: try to improve Qwen3 Next (#18683) 
* qwen3next: simplify qkvz projection

* use ggml_swiglu_split

* revert swiglu_split, but remove redundant repeat()

* fix missing reshape

* rm 2 redundant transposes

* move mul_mat(k,q) to outside of chunking

* rm redundant cont

* improve g_cs_chunk

* add comments about no cont

* use std::pair instead of ggml_concat

* vectorize key_gdiff calculation

* rm unused tensor

* avoid ggml_concat inside loop

* bring back ggml_concat as it may not work on other backend

* nits
2026-01-11 12:53:33 +01:00
..
afmoe.cpp
llama : refactor rope_freq_base/scale_swa conversion and init (#18553)
2026-01-05 09:14:04 +01:00
apertus.cpp
refactor : llama-model.cpp (#16252)
2025-10-31 23:40:23 +01:00
arcee.cpp
refactor : llama-model.cpp (#16252)
2025-10-31 23:40:23 +01:00
arctic.cpp
refactor : llama-model.cpp (#16252)
2025-10-31 23:40:23 +01:00
arwkv7.cpp
refactor : llama-model.cpp (#16252)
2025-10-31 23:40:23 +01:00
baichuan.cpp
refactor : llama-model.cpp (#16252)
2025-10-31 23:40:23 +01:00
bailingmoe2.cpp
refactor : llama-model.cpp (#16252)
2025-10-31 23:40:23 +01:00
bailingmoe.cpp
refactor : llama-model.cpp (#16252)
2025-10-31 23:40:23 +01:00
bert.cpp
model : add support for JinaBertModel with non-gated ffn (#18475)
2026-01-01 18:38:51 +01:00
bitnet.cpp
refactor : llama-model.cpp (#16252)
2025-10-31 23:40:23 +01:00
bloom.cpp
refactor : llama-model.cpp (#16252)
2025-10-31 23:40:23 +01:00
chameleon.cpp
refactor : llama-model.cpp (#16252)
2025-10-31 23:40:23 +01:00
chatglm.cpp
refactor : llama-model.cpp (#16252)
2025-10-31 23:40:23 +01:00
codeshell.cpp
refactor : llama-model.cpp (#16252)
2025-10-31 23:40:23 +01:00
cogvlm.cpp
graph : reduce topology branching (#18548)
2026-01-02 19:01:56 +02:00
cohere2-iswa.cpp
llama : refactor rope_freq_base/scale_swa conversion and init (#18553)
2026-01-05 09:14:04 +01:00
command-r.cpp
refactor : llama-model.cpp (#16252)
2025-10-31 23:40:23 +01:00
dbrx.cpp
refactor : llama-model.cpp (#16252)
2025-10-31 23:40:23 +01:00
deci.cpp
refactor : llama-model.cpp (#16252)
2025-10-31 23:40:23 +01:00
deepseek2.cpp
model: support youtu-vl model (#18479)
2026-01-01 19:25:54 +01:00
deepseek.cpp
refactor : llama-model.cpp (#16252)
2025-10-31 23:40:23 +01:00
dots1.cpp
refactor : llama-model.cpp (#16252)
2025-10-31 23:40:23 +01:00
dream.cpp
refactor : llama-model.cpp (#16252)
2025-10-31 23:40:23 +01:00
ernie4-5-moe.cpp
refactor : llama-model.cpp (#16252)
2025-10-31 23:40:23 +01:00
ernie4-5.cpp
models : move build_inp_out_ids outside loop (#17151)
2025-11-10 22:55:30 +01:00
exaone4.cpp
refactor : llama-model.cpp (#16252)
2025-10-31 23:40:23 +01:00
exaone.cpp
refactor : llama-model.cpp (#16252)
2025-10-31 23:40:23 +01:00
falcon-h1.cpp
refactor : llama-model.cpp (#16252)
2025-10-31 23:40:23 +01:00
falcon.cpp
refactor : llama-model.cpp (#16252)
2025-10-31 23:40:23 +01:00
gemma2-iswa.cpp
llama : refactor rope_freq_base/scale_swa conversion and init (#18553)
2026-01-05 09:14:04 +01:00
gemma3.cpp
graph : reduce topology branching (#18548)
2026-01-02 19:01:56 +02:00
gemma3n-iswa.cpp
mtmd: Add Gemma3n multimodal support with MobileNetV5 vision encoder (#18256)
2026-01-09 23:42:38 +01:00
gemma-embedding.cpp
graph : reduce topology branching (#18548)
2026-01-02 19:01:56 +02:00
gemma.cpp
refactor : llama-model.cpp (#16252)
2025-10-31 23:40:23 +01:00
glm4-moe.cpp
model: support GLM4V vision encoder (#18042)
2025-12-16 11:25:26 +01:00
glm4.cpp
model: support GLM4V vision encoder (#18042)
2025-12-16 11:25:26 +01:00
gpt2.cpp
refactor : llama-model.cpp (#16252)
2025-10-31 23:40:23 +01:00
gptneox.cpp
refactor : llama-model.cpp (#16252)
2025-10-31 23:40:23 +01:00
granite-hybrid.cpp
refactor : llama-model.cpp (#16252)
2025-10-31 23:40:23 +01:00
granite.cpp
refactor : llama-model.cpp (#16252)
2025-10-31 23:40:23 +01:00
graph-context-mamba.cpp
refactor : llama-model.cpp (#16252)
2025-10-31 23:40:23 +01:00
grok.cpp
chore : fix models indent after refactor (#16992)
2025-11-04 12:29:15 +01:00
grovemoe.cpp
refactor : llama-model.cpp (#16252)
2025-10-31 23:40:23 +01:00
hunyuan-dense.cpp
chore : fix models indent after refactor (#16992)
2025-11-04 12:29:15 +01:00
hunyuan-moe.cpp
chore : fix models indent after refactor (#16992)
2025-11-04 12:29:15 +01:00
internlm2.cpp
chore : fix models indent after refactor (#16992)
2025-11-04 12:29:15 +01:00
jais.cpp
chore : fix models indent after refactor (#16992)
2025-11-04 12:29:15 +01:00
jamba.cpp
chore : fix models indent after refactor (#16992)
2025-11-04 12:29:15 +01:00
lfm2.cpp
models : fix LFM2 tensors (#17548)
2025-11-27 16:04:29 +02:00
llada-moe.cpp
chore : fix models indent after refactor (#16992)
2025-11-04 12:29:15 +01:00
llada.cpp
chore : fix models indent after refactor (#16992)
2025-11-04 12:29:15 +01:00
llama-iswa.cpp
llama : refactor rope_freq_base/scale_swa conversion and init (#18553)
2026-01-05 09:14:04 +01:00
llama.cpp
model : support for LlamaBidirectionalModel architecture (#18220)
2025-12-24 14:02:36 +01:00
maincoder.cpp
model : Maincoder-1B support (#18534)
2026-01-02 20:11:59 +01:00
mamba.cpp
refactor : llama-model.cpp (#16252)
2025-10-31 23:40:23 +01:00
mimo2-iswa.cpp
model: support MiMo-V2-Flash (#18328)
2025-12-24 23:07:08 +01:00
minicpm3.cpp
chore : fix models indent after refactor (#16992)
2025-11-04 12:29:15 +01:00
minimax-m2.cpp
refactor : llama-model.cpp (#16252)
2025-10-31 23:40:23 +01:00
mistral3.cpp
model: support Ministral3 (#17644)
2025-12-01 12:26:52 +01:00
models.h
model: try to improve Qwen3 Next (#18683)
2026-01-11 12:53:33 +01:00
modern-bert.cpp
llama : refactor rope_freq_base/scale_swa conversion and init (#18553)
2026-01-05 09:14:04 +01:00
mpt.cpp
refactor : llama-model.cpp (#16252)
2025-10-31 23:40:23 +01:00
nemotron-h.cpp
llama : add support for NVIDIA Nemotron 3 Nano (#18058)
2025-12-16 07:19:26 +01:00
nemotron.cpp
chore : fix models indent after refactor (#16992)
2025-11-04 12:29:15 +01:00
neo-bert.cpp
chore : fix models indent after refactor (#16992)
2025-11-04 12:29:15 +01:00
olmo2.cpp
chore : fix models indent after refactor (#16992)
2025-11-04 12:29:15 +01:00
olmo.cpp
chore : fix models indent after refactor (#16992)
2025-11-04 12:29:15 +01:00
olmoe.cpp
chore : fix models indent after refactor (#16992)
2025-11-04 12:29:15 +01:00
openai-moe-iswa.cpp
llama : refactor rope_freq_base/scale_swa conversion and init (#18553)
2026-01-05 09:14:04 +01:00
openelm.cpp
chore : fix models indent after refactor (#16992)
2025-11-04 12:29:15 +01:00
orion.cpp
chore : fix models indent after refactor (#16992)
2025-11-04 12:29:15 +01:00
pangu-embedded.cpp
model : add openPangu-Embedded (#16941)
2025-11-05 10:28:58 +01:00
phi2.cpp
refactor : llama-model.cpp (#16252)
2025-10-31 23:40:23 +01:00
phi3.cpp
chore : fix models indent after refactor (#16992)
2025-11-04 12:29:15 +01:00
plamo2.cpp
refactor : llama-model.cpp (#16252)
2025-10-31 23:40:23 +01:00
plamo3.cpp
model : Plamo3 support (#17304)
2025-12-28 17:28:31 +01:00
plamo.cpp
chore : fix models indent after refactor (#16992)
2025-11-04 12:29:15 +01:00
plm.cpp
chore : fix models indent after refactor (#16992)
2025-11-04 12:29:15 +01:00
qwen2.cpp
model : add KORMo model (#18032)
2025-12-15 18:51:43 +01:00
qwen2moe.cpp
chore : fix models indent after refactor (#16992)
2025-11-04 12:29:15 +01:00
qwen2vl.cpp
chore : fix models indent after refactor (#16992)
2025-11-04 12:29:15 +01:00
qwen3.cpp
chore : fix models indent after refactor (#16992)
2025-11-04 12:29:15 +01:00
qwen3moe.cpp
chore : fix models indent after refactor (#16992)
2025-11-04 12:29:15 +01:00
qwen3next.cpp
model: try to improve Qwen3 Next (#18683)
2026-01-11 12:53:33 +01:00
qwen3vl-moe.cpp
hparams : add n_embd_inp() to support extended embed (#16928)
2025-11-07 19:27:58 +01:00
qwen3vl.cpp
hparams : add n_embd_inp() to support extended embed (#16928)
2025-11-07 19:27:58 +01:00
qwen.cpp
refactor : llama-model.cpp (#16252)
2025-10-31 23:40:23 +01:00
refact.cpp
chore : fix models indent after refactor (#16992)
2025-11-04 12:29:15 +01:00
rnd1.cpp
models : Added support for RND1 Diffusion Language Model (#17433)
2025-11-24 14:16:56 +08:00
rwkv6-base.cpp
refactor : llama-model.cpp (#16252)
2025-10-31 23:40:23 +01:00
rwkv6.cpp
refactor : llama-model.cpp (#16252)
2025-10-31 23:40:23 +01:00
rwkv6qwen2.cpp
refactor : llama-model.cpp (#16252)
2025-10-31 23:40:23 +01:00
rwkv7-base.cpp
refactor : llama-model.cpp (#16252)
2025-10-31 23:40:23 +01:00
rwkv7.cpp
refactor : llama-model.cpp (#16252)
2025-10-31 23:40:23 +01:00
seed-oss.cpp
chore : fix models indent after refactor (#16992)
2025-11-04 12:29:15 +01:00
smallthinker.cpp
llama : refactor rope_freq_base/scale_swa conversion and init (#18553)
2026-01-05 09:14:04 +01:00
smollm3.cpp
chore : fix models indent after refactor (#16992)
2025-11-04 12:29:15 +01:00
stablelm.cpp
refactor : llama-model.cpp (#16252)
2025-10-31 23:40:23 +01:00
starcoder2.cpp
chore : fix models indent after refactor (#16992)
2025-11-04 12:29:15 +01:00
starcoder.cpp
chore : fix models indent after refactor (#16992)
2025-11-04 12:29:15 +01:00
t5-dec.cpp
chore : fix models indent after refactor (#16992)
2025-11-04 12:29:15 +01:00
t5-enc.cpp
chore : fix models indent after refactor (#16992)
2025-11-04 12:29:15 +01:00
wavtokenizer-dec.cpp
chore : fix models indent after refactor (#16992)
2025-11-04 12:29:15 +01:00
xverse.cpp
chore : fix models indent after refactor (#16992)
2025-11-04 12:29:15 +01:00