llama.cpp/src
Georgi Gerganov d7d826b3c1
server : support multi-modal context checkpoints (#19849)
* Modify llama-memory-hybrid-iswa.cpp

* Modify llama-memory-recurrent.cpp

* Modify server-common.cpp

* Modify server-common.h

* Modify server-context.cpp

* Modify server-task.h

* Added comment to llama-memory-hybrid-iswa.cpp

* Remove comment from server-context.cpp

* Stylistic fix server-context.cpp

* Fix an issue when seqrm isn't called in server-context.cpp

* cont : alternative impl

* cont : cleanup

* cont : n_tokens -> int64_t

---------

Co-authored-by: timkhronos <timkhronos@gmail.com>
2026-02-25 15:14:27 +02:00
..
models models : fix graph splits (#19866) 2026-02-25 00:01:13 +02:00
CMakeLists.txt model: Add PaddleOCR-VL model support (#18825) 2026-02-19 17:05:25 +01:00
llama-adapter.cpp lora: make sure model keep track of associated adapters (#18490) 2026-01-15 10:24:28 +01:00
llama-adapter.h graph : fix KQ mask, lora, cvec reuse checks (#19644) 2026-02-16 09:21:11 +02:00
llama-arch.cpp model: Add PaddleOCR-VL model support (#18825) 2026-02-19 17:05:25 +01:00
llama-arch.h model: Add PaddleOCR-VL model support (#18825) 2026-02-19 17:05:25 +01:00
llama-batch.cpp batch : fix sequence id ownership (#17915) 2025-12-11 14:29:47 +02:00
llama-batch.h batch : fix sequence id ownership (#17915) 2025-12-11 14:29:47 +02:00
llama-chat.cpp docs : Minor cleanups (#19252) 2026-02-02 08:38:55 +02:00
llama-chat.h model : add EXAONE MoE (#18543) 2026-01-13 23:28:38 +01:00
llama-context.cpp llama : remove write/read of output ids/logits/embeddings (#18862) 2026-02-23 07:04:30 +01:00
llama-context.h graph : fix KQ mask, lora, cvec reuse checks (#19644) 2026-02-16 09:21:11 +02:00
llama-cparams.cpp cparams : rename LLAMA_MAX_PARALLEL_SEQUENCES to LLAMA_MAX_SEQ (#14188) 2025-06-15 10:08:58 +03:00
llama-cparams.h context : reserve new scheduler when graph topology changes (#18547) 2026-01-15 16:39:17 +02:00
llama-grammar.cpp llama : rename llama-sampling to llama-sampler (#19363) 2026-02-06 07:26:54 +01:00
llama-grammar.h common/grammar : replace problematic backtracking regex `[\s\S]*` (#18342) 2026-01-03 16:02:43 -06:00
llama-graph.cpp model : add JAIS-2 architecture support (#19488) 2026-02-19 13:30:17 +01:00
llama-graph.h model : add tokenizer from LFM2.5-Audio-1.5B (#19687) 2026-02-19 09:54:48 +01:00
llama-hparams.cpp Kimi-Linear support (backend agnostic + MLA KV cache) (#18755) 2026-02-06 11:39:58 +01:00
llama-hparams.h model: support GLM MoE DSA arch (NOTE: indexer is not yet supported) (#19460) 2026-02-13 14:56:53 +01:00
llama-impl.cpp quantize : add --dry-run option (#19526) 2026-02-20 09:20:16 +01:00
llama-impl.h llama : refactor sampling_info to use buffer_view template (#19368) 2026-02-11 05:38:13 +01:00
llama-io.cpp llama : refactor llama_context, llama_kv_cache, llm_build_context (#12181) 2025-03-13 12:35:44 +02:00
llama-io.h llama : refactor llama_context, llama_kv_cache, llm_build_context (#12181) 2025-03-13 12:35:44 +02:00
llama-kv-cache-iswa.cpp model : support Step3.5-Flash (#19283) 2026-02-06 21:06:14 +01:00
llama-kv-cache-iswa.h llama: print memory breakdown on exit (#15860) 2025-09-24 16:53:48 +02:00
llama-kv-cache.cpp model : support Step3.5-Flash (#19283) 2026-02-06 21:06:14 +01:00
llama-kv-cache.h kv-cache : optimize KQ mask construction (#18842) 2026-01-17 15:42:42 +02:00
llama-kv-cells.h llama: store mrope data in KV cell (#16825) 2025-10-29 18:09:18 +01:00
llama-memory-hybrid-iswa.cpp memory : add llama_memory_hybrid_iswa (#18601) 2026-01-21 14:30:23 +02:00
llama-memory-hybrid-iswa.h memory : add llama_memory_hybrid_iswa (#18601) 2026-01-21 14:30:23 +02:00
llama-memory-hybrid.cpp graph : reuse SSM graphs (#16490) 2025-12-16 09:36:21 +02:00
llama-memory-hybrid.h llama: print memory breakdown on exit (#15860) 2025-09-24 16:53:48 +02:00
llama-memory-recurrent.cpp server : support multi-modal context checkpoints (#19849) 2026-02-25 15:14:27 +02:00
llama-memory-recurrent.h llama: consistent ctx <-> buf order for KV cache (#16746) 2025-10-28 11:23:54 +01:00
llama-memory.cpp memory : correctly handle failure in apply() (#14438) 2025-06-30 18:03:03 +03:00
llama-memory.h llama: print memory breakdown on exit (#15860) 2025-09-24 16:53:48 +02:00
llama-mmap.cpp mmap: Fix Windows handle lifetime (#19598) 2026-02-14 10:05:12 +02:00
llama-mmap.h llama : add `use_direct_io` flag for model loading (#18166) 2026-01-08 08:35:30 +02:00
llama-model-loader.cpp llama : disable Direct IO by default (#19109) 2026-01-28 09:11:13 +02:00
llama-model-loader.h llama : add `use_direct_io` flag for model loading (#18166) 2026-01-08 08:35:30 +02:00
llama-model-saver.cpp model : full modern bert support (#18330) 2026-02-19 08:52:21 +01:00
llama-model-saver.h llama/ggml: add LLM training support (#10544) 2025-05-12 14:44:49 +02:00
llama-model.cpp model : update label for LFM2-24B-A2B (#19848) 2026-02-24 14:27:42 +01:00
llama-model.h model : update label for LFM2-24B-A2B (#19848) 2026-02-24 14:27:42 +01:00
llama-quant.cpp quantize : add --dry-run option (#19526) 2026-02-20 09:20:16 +01:00
llama-quant.h llama : refactor `src/llama.cpp` (#10902) 2025-01-03 10:18:53 +02:00
llama-sampler.cpp llama : rename llama-sampling to llama-sampler (#19363) 2026-02-06 07:26:54 +01:00
llama-sampler.h llama : rename llama-sampling to llama-sampler (#19363) 2026-02-06 07:26:54 +01:00
llama-vocab.cpp model : add Kanana-2 model support (#19803) 2026-02-22 16:15:02 +01:00
llama-vocab.h model : add JAIS-2 architecture support (#19488) 2026-02-19 13:30:17 +01:00
llama.cpp llama: fix integer type consistency in split helpers (#18894) 2026-01-25 09:10:52 +02:00
unicode-data.cpp server : better security control for public deployments (#9776) 2024-10-08 13:27:04 +02:00
unicode-data.h
unicode.cpp model: Add support for Tiny Aya Models (#19611) 2026-02-16 16:28:46 +01:00
unicode.h devops: add s390x & ppc64le CI (#15925) 2025-09-27 02:03:33 +08:00