llama.cpp/tools
Georgi Gerganov e92d53b29e
sampling : optimize samplers by reusing bucket sort (#15665)
* sampling : optimize sorting using bucket sort in more places

ggml-ci

* sampling : do not sort in dist sampler

ggml-ci

* sampling : avoid heap allocations for sort buffers

ggml-ci

* common : add option to sort sampling candidates by probability

ggml-ci

* sampling : revert the change for preserving sort buffers

* sampling : use std::copy instead of memcpy

* sampling : clarify purpose of partial sort helpers

ggml-ci

* cont : remove wrong comment [no ci]

* common : update comment

Co-authored-by: Johannes Gäßler <johannesg@5d6.de>

---------

Co-authored-by: Johannes Gäßler <johannesg@5d6.de>
2025-08-31 20:41:02 +03:00
..
batched-bench llama: use FA + max. GPU layers by default (#15434) 2025-08-30 16:32:10 +02:00
cvector-generator llama : deprecate llama_kv_self_ API (#14030) 2025-06-06 14:11:15 +03:00
export-lora mtmd : fix 32-bit narrowing issue in export-lora and mtmd clip (#14503) 2025-07-25 13:08:04 +02:00
gguf-split scripts : make the shell scripts cross-platform (#14341) 2025-06-30 10:17:18 +02:00
imatrix imatrix : warn when GGUF imatrix is saved without .gguf suffix (#15076) 2025-08-04 23:26:52 +02:00
llama-bench llama: use FA + max. GPU layers by default (#15434) 2025-08-30 16:32:10 +02:00
main cli : change log to warning to explain reason for stopping (#15604) 2025-08-28 10:48:20 +03:00
mtmd mtmd : fix mtmd ios build (#15579) 2025-08-26 20:05:50 +02:00
perplexity perplexity: give more information about constraints on failure (#15303) 2025-08-14 09:16:32 +03:00
quantize llama : add gpt-oss (#15091) 2025-08-05 22:10:36 +03:00
rpc rpc : Fix build on OpenBSD (#13541) 2025-05-25 15:35:53 +03:00
run cmake : do not search for curl libraries by ourselves (#14613) 2025-07-10 15:29:05 +03:00
server sampling : optimize samplers by reusing bucket sort (#15665) 2025-08-31 20:41:02 +03:00
tokenize llama : move end-user examples to tools directory (#13249) 2025-05-02 20:27:13 +02:00
tts sampling : optimize samplers by reusing bucket sort (#15665) 2025-08-31 20:41:02 +03:00
CMakeLists.txt mtmd : rename llava directory to mtmd (#13311) 2025-05-05 16:02:55 +02:00