happyz
/
llama.cpp
mirror of https://github.com/ggerganov/llama.cpp.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
llama.cpp/examples/idle
History
Georgi Gerganov c41bde6fbd
metal : add residency sets keep-alive heartbeat (#17766) 
* examples : add idle

* metal : attach residency sets to queue

* idle : add link

* idle : adjust intervals

* metal : add residency sets keep-alive heartbeat

* cont : adjust default keep-alive time
 		2025-12-05 19:38:54 +02:00
..
CMakeLists.txt metal : add residency sets keep-alive heartbeat (#17766) 2025-12-05 19:38:54 +02:00
README.md metal : add residency sets keep-alive heartbeat (#17766) 2025-12-05 19:38:54 +02:00
idle.cpp metal : add residency sets keep-alive heartbeat (#17766) 2025-12-05 19:38:54 +02:00

README.md

llama.cpp/example/idle

https://github.com/ggml-org/llama.cpp/pull/17766