happyz
/
llama.cpp
mirror of https://github.com/ggerganov/llama.cpp.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
llama.cpp/tools/server/tests/unit
History
Matthieu Beaumont 0252fd253b feat(server): add cache_read_input_tokens to usage metrics and response structure 
- Added `n_cache_read_input_tokens` field to `server_task_result_cmpl_final` and `server_task_result_cmpl_partial` structs
- Populated `cache_read_input_tokens` in JSON output for both final and streaming responses
- Ensured `cache_read_input_tokens` is non-negative by clamping to zero if negative
- Updated unit tests to validate presence, type, and non-negativity of `cache_read_input_tokens` in usage metrics
 		2026-02-12 18:52:22 +01:00
..
test_basic.py server: add router multi-model tests (#17704) (#17722) 2025-12-03 15:10:37 +01:00
test_chat_completion.py server: improve slots scheduling for n_cmpl (#18789) 2026-01-15 17:10:28 +01:00
test_compat_anthropic.py feat(server): add cache_read_input_tokens to usage metrics and response structure 2026-02-12 18:52:22 +01:00
test_compat_oai_responses.py server: /v1/responses (partial) (#18486) 2026-01-21 17:47:23 +01:00
test_completion.py server : adjust unified KV cache tests (#18716) 2026-01-10 17:51:56 +02:00
test_ctx_shift.py memory : remove KV cache size padding (#16812) 2025-10-28 20:19:44 +02:00
test_embedding.py server : disable context shift by default (#15416) 2025-08-19 16:46:37 +03:00
test_infill.py server : support unified cache across slots (#16736) 2025-11-02 18:14:04 +02:00
test_lora.py server : disable context shift by default (#15416) 2025-08-19 16:46:37 +03:00
test_rerank.py server / ranking : add sorting and management of top_n (#16403) 2025-10-11 16:39:04 +03:00
test_router.py server: add router multi-model tests (#17704) (#17722) 2025-12-03 15:10:37 +01:00
test_security.py server: add --media-path for local media files (#17697) 2025-12-02 22:49:20 +01:00
test_sleep.py server: add auto-sleep after N seconds of idle (#18228) 2025-12-21 02:24:42 +01:00
test_slot_save.py server : disable context shift by default (#15416) 2025-08-19 16:46:37 +03:00
test_speculative.py server : adjust spec tests to generate up to 16 tokens (#19093) 2026-01-28 09:11:40 +02:00
test_template.py server : speed up tests (#15836) 2025-09-06 14:45:24 +02:00
test_tokenize.py server : disable context shift by default (#15416) 2025-08-19 16:46:37 +03:00
test_tool_call.py server : speed up tests (#15836) 2025-09-06 14:45:24 +02:00
test_vision_api.py server : speed up tests (#15836) 2025-09-06 14:45:24 +02:00