Xuan-Son Nguyen c42712b056 server: support multiple generations from one prompt (OAI "n" option) (#17775) ... * backend support * server: support multiple generations from one prompt (OAI "n" option) * fix invalid batch * format oai * clean up * disable ctx shift * add test * update comments * fix style * add n_cmpl to docs [no ci] * allowing using both n_cmpl and n		2025-12-06 15:54:38 +01:00
..
test_basic.py	server: add router multi-model tests (#17704) (#17722)	2025-12-03 15:10:37 +01:00
test_chat_completion.py	server: support multiple generations from one prompt (OAI "n" option) (#17775)	2025-12-06 15:54:38 +01:00
test_compat_anthropic.py	server : add Anthropic Messages API support (#17570)	2025-11-28 12:57:04 +01:00
test_completion.py	server : handle failures to restore host cache (#17078)	2025-11-09 14:27:05 +02:00
test_ctx_shift.py	memory : remove KV cache size padding (#16812)	2025-10-28 20:19:44 +02:00
test_embedding.py	server : disable context shift by default (#15416)	2025-08-19 16:46:37 +03:00
test_infill.py	server : support unified cache across slots (#16736)	2025-11-02 18:14:04 +02:00
test_lora.py	server : disable context shift by default (#15416)	2025-08-19 16:46:37 +03:00
test_rerank.py	server / ranking : add sorting and management of top_n (#16403)	2025-10-11 16:39:04 +03:00
test_router.py	server: add router multi-model tests (#17704) (#17722)	2025-12-03 15:10:37 +01:00
test_security.py	server: add --media-path for local media files (#17697)	2025-12-02 22:49:20 +01:00
test_slot_save.py	server : disable context shift by default (#15416)	2025-08-19 16:46:37 +03:00
test_speculative.py	kv-cache : pad the cache size to 256 for performance (#17046)	2025-11-07 20:03:25 +02:00
test_template.py	server : speed up tests (#15836)	2025-09-06 14:45:24 +02:00
test_tokenize.py	server : disable context shift by default (#15416)	2025-08-19 16:46:37 +03:00
test_tool_call.py	server : speed up tests (#15836)	2025-09-06 14:45:24 +02:00
test_vision_api.py	server : speed up tests (#15836)	2025-09-06 14:45:24 +02:00