Georgi Gerganov
|
2fcdf869cd
|
batched-bench : add mmq CLI arg
|
2023-10-11 19:42:33 +03:00 |
|
Georgi Gerganov
|
daeb834da9
|
batched-bench : pass custom set of PP, TG and PL
|
2023-10-11 19:36:31 +03:00 |
|
Georgi Gerganov
|
c062ffd18c
|
batched-bench : init warm-up batch
|
2023-10-11 19:24:59 +03:00 |
|
Georgi Gerganov
|
026bb1b1cd
|
batched-bench : add readme + n_kv_max is now configurable
|
2023-10-11 19:10:35 +03:00 |
|
Georgi Gerganov
|
7438728d51
|
batched : minor fix table
|
2023-10-08 16:35:54 +03:00 |
|
Georgi Gerganov
|
bf06d654de
|
batched : add bench tool
|
2023-10-08 15:57:16 +03:00 |