llama.cpp/src/models
Xuan-Son Nguyen 4cbafad4f0
model: support MiMo-V2-Flash (#18328)
* mimov2: convert ok

* rename mimov2 --> mimo2

* fix conversion

* runnable not incorrect

* use sink

* add_sliding_window_pattern

* add swa and per-layer n_head_kv

* correct params

* somewhat working

* correct gating func

* nits

* mimo2: wire RMS eps + MoE bias + converter guards

* add co-author

Co-authored-by: Aaryan-Kapoor <Aaryan-Kapoor@users.noreply.github.com>

* use add_rope_freq_base_swa

---------

Co-authored-by: Aaryan Kapoor <aaryankapoor2006@gmail.com>
Co-authored-by: Aaryan-Kapoor <Aaryan-Kapoor@users.noreply.github.com>
2025-12-24 23:07:08 +01:00
..
afmoe.cpp model : add AfmoeForCausalLM support (#16477) 2025-11-14 13:54:10 +01:00
apertus.cpp
arcee.cpp
arctic.cpp
arwkv7.cpp
baichuan.cpp
bailingmoe.cpp
bailingmoe2.cpp
bert.cpp
bitnet.cpp
bloom.cpp
chameleon.cpp
chatglm.cpp
codeshell.cpp
cogvlm.cpp
cohere2-iswa.cpp
command-r.cpp
dbrx.cpp
deci.cpp
deepseek.cpp
deepseek2.cpp models : fix the attn_factor for mistral3 graphs + improve consistency (#17945) 2025-12-12 17:12:40 +02:00
dots1.cpp
dream.cpp
ernie4-5-moe.cpp
ernie4-5.cpp models : move build_inp_out_ids outside loop (#17151) 2025-11-10 22:55:30 +01:00
exaone.cpp
exaone4.cpp
falcon-h1.cpp
falcon.cpp
gemma-embedding.cpp
gemma.cpp
gemma2-iswa.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
gemma3.cpp model : support Rnj-1 (#17811) 2025-12-09 04:49:03 +01:00
gemma3n-iswa.cpp
glm4-moe.cpp model: support GLM4V vision encoder (#18042) 2025-12-16 11:25:26 +01:00
glm4.cpp model: support GLM4V vision encoder (#18042) 2025-12-16 11:25:26 +01:00
gpt2.cpp
gptneox.cpp
granite-hybrid.cpp
granite.cpp
graph-context-mamba.cpp
grok.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
grovemoe.cpp
hunyuan-dense.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
hunyuan-moe.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
internlm2.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
jais.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
jamba.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
lfm2.cpp models : fix LFM2 tensors (#17548) 2025-11-27 16:04:29 +02:00
llada-moe.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
llada.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
llama-iswa.cpp
llama.cpp model : support for LlamaBidirectionalModel architecture (#18220) 2025-12-24 14:02:36 +01:00
mamba.cpp
mimo2-iswa.cpp model: support MiMo-V2-Flash (#18328) 2025-12-24 23:07:08 +01:00
minicpm3.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
minimax-m2.cpp
mistral3.cpp model: support Ministral3 (#17644) 2025-12-01 12:26:52 +01:00
models.h model: support MiMo-V2-Flash (#18328) 2025-12-24 23:07:08 +01:00
modern-bert.cpp model : Granite Embedding support (#15641) 2025-12-23 00:28:19 +01:00
mpt.cpp
nemotron-h.cpp llama : add support for NVIDIA Nemotron 3 Nano (#18058) 2025-12-16 07:19:26 +01:00
nemotron.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
neo-bert.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
olmo.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
olmo2.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
olmoe.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
openai-moe-iswa.cpp models : move build_inp_out_ids outside loop (#17151) 2025-11-10 22:55:30 +01:00
openelm.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
orion.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
pangu-embedded.cpp model : add openPangu-Embedded (#16941) 2025-11-05 10:28:58 +01:00
phi2.cpp
phi3.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
plamo.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
plamo2.cpp
plm.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
qwen.cpp
qwen2.cpp model : add KORMo model (#18032) 2025-12-15 18:51:43 +01:00
qwen2moe.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
qwen2vl.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
qwen3.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
qwen3moe.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
qwen3next.cpp Optimization: Qwen3 next autoregressive pass (#17996) 2025-12-16 11:59:53 +01:00
qwen3vl-moe.cpp hparams : add n_embd_inp() to support extended embed (#16928) 2025-11-07 19:27:58 +01:00
qwen3vl.cpp hparams : add n_embd_inp() to support extended embed (#16928) 2025-11-07 19:27:58 +01:00
refact.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
rnd1.cpp models : Added support for RND1 Diffusion Language Model (#17433) 2025-11-24 14:16:56 +08:00
rwkv6-base.cpp
rwkv6.cpp
rwkv6qwen2.cpp
rwkv7-base.cpp
rwkv7.cpp
seed-oss.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
smallthinker.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
smollm3.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
stablelm.cpp
starcoder.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
starcoder2.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
t5-dec.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
t5-enc.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
wavtokenizer-dec.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
xverse.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00