happyz
/
llama.cpp
mirror of https://github.com/ggerganov/llama.cpp.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
3,172 Commits 529 Branches 5,222 Tags 1.1 GiB
Commit Graph

2 Commits

Author SHA1 Message Date
Olivier Chafik ab5efbb3b6 Prefix all example bins w/ llama- 2024-06-08 13:42:01 +01:00
Georgi Gerganov 8c70a5ff25
batched : add bench tool (#3545) 
* batched : add bench tool

* batched : minor fix table

* batched-bench : add readme + n_kv_max is now configurable

* batched-bench : init warm-up batch

* batched-bench : pass custom set of PP, TG and PL

* batched-bench : add mmq CLI arg
 2023-10-11 21:25:33 +03:00