llama.cpp/tools
ssweens be79d9fdd9
llama-bench: add --devices and --list-devices support (#16039)
* * llama-bench: add --devices support
- Support --devices same as llama-server
- Provide for benchmarking different device combinations
- Include --list-devices like llama-server for convenience

* fix: field display ordering restored

* fix: integrated the rpc devices
- aimed to mimic the server as much as possible

* cleanup: defaults for list-devices
- handle dup device listing with RPC

* cleanup: remove dup device load calls

* docs: update llama-bench
- added the recently added n-cpu-moe option to the docs while in there

* llama-bench: rpc device simplification
* rpc servers unify with other devices earlier, simplifying code
* --list-devices made stateless and simpler
* various cleanup
2025-09-20 00:15:21 +02:00
..
batched-bench cmake : Do not install tools on iOS targets (#15903) 2025-09-16 09:54:44 +07:00
cvector-generator cmake : Do not install tools on iOS targets (#15903) 2025-09-16 09:54:44 +07:00
export-lora cmake : Do not install tools on iOS targets (#15903) 2025-09-16 09:54:44 +07:00
gguf-split cmake : Do not install tools on iOS targets (#15903) 2025-09-16 09:54:44 +07:00
imatrix cmake : Do not install tools on iOS targets (#15903) 2025-09-16 09:54:44 +07:00
llama-bench llama-bench: add --devices and --list-devices support (#16039) 2025-09-20 00:15:21 +02:00
main cmake : Do not install tools on iOS targets (#15903) 2025-09-16 09:54:44 +07:00
mtmd cmake : Do not install tools on iOS targets (#15903) 2025-09-16 09:54:44 +07:00
perplexity cmake : Do not install tools on iOS targets (#15903) 2025-09-16 09:54:44 +07:00
quantize cmake : Do not install tools on iOS targets (#15903) 2025-09-16 09:54:44 +07:00
rpc rpc : fix regression when --device is used (#15981) 2025-09-14 12:28:18 +03:00
run cmake : Do not install tools on iOS targets (#15903) 2025-09-16 09:54:44 +07:00
server feat: Improve mobile UI for Settings Dialog (#16084) 2025-09-19 09:52:27 +02:00
tokenize cmake : Do not install tools on iOS targets (#15903) 2025-09-16 09:54:44 +07:00
tts cmake : Do not install tools on iOS targets (#15903) 2025-09-16 09:54:44 +07:00
CMakeLists.txt mtmd : rename llava directory to mtmd (#13311) 2025-05-05 16:02:55 +02:00