llama.cpp/src/models
Piotr Wilkin (ilintar) ff55414c42
model : Qwen3 Next (#16095)
* Qwen3 Next - cleaned up version

* Whitespaces and stuff

* Correct minor errors

* Update src/llama-model.cpp

Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>

* Misc. fixes.

* Clean up code, add missing hybrid qualifier

* Did someone transpose the SOLVE_TRI result matrix? Perhaps...

* Whitespace

* Proper tensors for cb calls

* Use llama-graph.h vertical alignment

* BROKEN: chunking

* Set new tensors as inputs.

* Proper chunk logic

* It's the circle of life...

* More shenanigans for n_seq > 1

* Nail in the coffin?

* Fix Windows build

* Eh, one fails on Windows, the other fails on Mac... just use general capture.

* quant : cleanup

* model : cleanup

* qwen3 : cleanup

* cont : cleanup

* cont : cleanup

* ggml : revert change

* qwen3 : cleanup

* cont : cleanup

* Readd cmath

* qwen3 : fix typo

* Update convert_hf_to_gguf.py

Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>

* Usual suspects

* fix my bad suggestion

---------

Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
2025-11-28 12:02:56 +01:00
..
afmoe.cpp model : add AfmoeForCausalLM support (#16477) 2025-11-14 13:54:10 +01:00
apertus.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
arcee.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
arctic.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
arwkv7.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
baichuan.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
bailingmoe.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
bailingmoe2.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
bert.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
bitnet.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
bloom.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
chameleon.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
chatglm.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
codeshell.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
cogvlm.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
cohere2-iswa.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
command-r.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
dbrx.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
deci.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
deepseek.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
deepseek2.cpp model : detect GigaChat3-10-A1.8B as deepseek lite (#17420) 2025-11-21 14:51:38 +01:00
dots1.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
dream.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
ernie4-5-moe.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
ernie4-5.cpp models : move build_inp_out_ids outside loop (#17151) 2025-11-10 22:55:30 +01:00
exaone.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
exaone4.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
falcon-h1.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
falcon.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
gemma-embedding.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
gemma.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
gemma2-iswa.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
gemma3-iswa.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
gemma3n-iswa.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
glm4-moe.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
glm4.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
gpt2.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
gptneox.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
granite-hybrid.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
granite.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
graph-context-mamba.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
grok.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
grovemoe.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
hunyuan-dense.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
hunyuan-moe.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
internlm2.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
jais.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
jamba.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
lfm2.cpp models : fix LFM2 tensors (#17548) 2025-11-27 16:04:29 +02:00
llada-moe.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
llada.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
llama-iswa.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
llama.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
mamba.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
minicpm3.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
minimax-m2.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
models.h model : Qwen3 Next (#16095) 2025-11-28 12:02:56 +01:00
mpt.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
nemotron-h.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
nemotron.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
neo-bert.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
olmo.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
olmo2.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
olmoe.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
openai-moe-iswa.cpp models : move build_inp_out_ids outside loop (#17151) 2025-11-10 22:55:30 +01:00
openelm.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
orion.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
pangu-embedded.cpp model : add openPangu-Embedded (#16941) 2025-11-05 10:28:58 +01:00
phi2.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
phi3.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
plamo.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
plamo2.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
plm.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
qwen.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
qwen2.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
qwen2moe.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
qwen2vl.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
qwen3.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
qwen3moe.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
qwen3next.cpp model : Qwen3 Next (#16095) 2025-11-28 12:02:56 +01:00
qwen3vl-moe.cpp hparams : add n_embd_inp() to support extended embed (#16928) 2025-11-07 19:27:58 +01:00
qwen3vl.cpp hparams : add n_embd_inp() to support extended embed (#16928) 2025-11-07 19:27:58 +01:00
refact.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
rnd1.cpp models : Added support for RND1 Diffusion Language Model (#17433) 2025-11-24 14:16:56 +08:00
rwkv6-base.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
rwkv6.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
rwkv6qwen2.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
rwkv7-base.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
rwkv7.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
seed-oss.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
smallthinker.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
smollm3.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
stablelm.cpp refactor : llama-model.cpp (#16252) 2025-10-31 23:40:23 +01:00
starcoder.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
starcoder2.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
t5-dec.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
t5-enc.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
wavtokenizer-dec.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00
xverse.cpp chore : fix models indent after refactor (#16992) 2025-11-04 12:29:15 +01:00