Radoslav Gerganov 41386cf365 rpc : report actual free memory (#16616) ... * rpc : report actual free memory Start reporting the free memory on every device instead of using fixed values. Now llama-cli users can get a nice memory breakdown when using RPC devices. * drop --mem in rpc-server		2025-10-17 18:02:52 +03:00
..
CMakeLists.txt	ggml : add support for dynamic loading of backends (#10469)	2024-11-25 15:13:39 +01:00
ggml-rpc.cpp	rpc : report actual free memory (#16616)	2025-10-17 18:02:52 +03:00