llama.cpp/ggml/src/ggml-virtgpu
Kevin Pouget 015deb9048
ggml-virtgpu: make the code thread safe (#19204)
* ggml-virtgpu: regenerate_remoting.py: add the ability to deprecate a function

* ggml-virtgpu: deprecate buffer_type is_host remoting

not necessary

* ggml-virtgpu: stop using static vars as cache

The static init isn't thread safe.

* ggml-virtgpu: protect the use of the shared memory to transfer data

* ggml-virtgpu: make the remote calls thread-safe

* ggml-virtgpu: backend: don't continue if couldn't allocate the tensor memory

* ggml-virtgpu: add a cleanup function for consistency

* ggml-virtgpu: backend: don't crash if buft->iface.get_max_size is missing

* fix style and ordering

* Remove the static variable in apir_device_get_count

* ggml-virtgpu: improve the logging

* fix review minor formatting changes
2026-02-04 10:46:18 +08:00
..
backend ggml-virtgpu: make the code thread safe (#19204) 2026-02-04 10:46:18 +08:00
include ggml: new backend for Virglrenderer API Remoting acceleration (v2) (#18718) 2026-01-28 17:49:40 +08:00
CMakeLists.txt ggml: new backend for Virglrenderer API Remoting acceleration (v2) (#18718) 2026-01-28 17:49:40 +08:00
apir_cs_ggml-rpc-front.cpp ggml-virtgpu: make the code thread safe (#19204) 2026-02-04 10:46:18 +08:00
ggml-backend-buffer-type.cpp ggml-virtgpu: make the code thread safe (#19204) 2026-02-04 10:46:18 +08:00
ggml-backend-buffer.cpp ggml: new backend for Virglrenderer API Remoting acceleration (v2) (#18718) 2026-01-28 17:49:40 +08:00
ggml-backend-device.cpp ggml-virtgpu: make the code thread safe (#19204) 2026-02-04 10:46:18 +08:00
ggml-backend-reg.cpp ggml-virtgpu: make the code thread safe (#19204) 2026-02-04 10:46:18 +08:00
ggml-backend.cpp ggml: new backend for Virglrenderer API Remoting acceleration (v2) (#18718) 2026-01-28 17:49:40 +08:00
ggml-remoting.h ggml-virtgpu: make the code thread safe (#19204) 2026-02-04 10:46:18 +08:00
ggmlremoting_functions.yaml ggml-virtgpu: make the code thread safe (#19204) 2026-02-04 10:46:18 +08:00
regenerate_remoting.py ggml-virtgpu: make the code thread safe (#19204) 2026-02-04 10:46:18 +08:00
virtgpu-apir.h ggml: new backend for Virglrenderer API Remoting acceleration (v2) (#18718) 2026-01-28 17:49:40 +08:00
virtgpu-forward-backend.cpp ggml-virtgpu: make the code thread safe (#19204) 2026-02-04 10:46:18 +08:00
virtgpu-forward-buffer-type.cpp ggml-virtgpu: make the code thread safe (#19204) 2026-02-04 10:46:18 +08:00
virtgpu-forward-buffer.cpp ggml-virtgpu: make the code thread safe (#19204) 2026-02-04 10:46:18 +08:00
virtgpu-forward-device.cpp ggml-virtgpu: make the code thread safe (#19204) 2026-02-04 10:46:18 +08:00
virtgpu-forward-impl.h ggml-virtgpu: make the code thread safe (#19204) 2026-02-04 10:46:18 +08:00
virtgpu-forward.gen.h ggml-virtgpu: make the code thread safe (#19204) 2026-02-04 10:46:18 +08:00
virtgpu-shm.cpp ggml-virtgpu: make the code thread safe (#19204) 2026-02-04 10:46:18 +08:00
virtgpu-shm.h ggml: new backend for Virglrenderer API Remoting acceleration (v2) (#18718) 2026-01-28 17:49:40 +08:00
virtgpu-utils.cpp ggml: new backend for Virglrenderer API Remoting acceleration (v2) (#18718) 2026-01-28 17:49:40 +08:00
virtgpu-utils.h ggml: new backend for Virglrenderer API Remoting acceleration (v2) (#18718) 2026-01-28 17:49:40 +08:00
virtgpu.cpp ggml-virtgpu: make the code thread safe (#19204) 2026-02-04 10:46:18 +08:00
virtgpu.h ggml-virtgpu: make the code thread safe (#19204) 2026-02-04 10:46:18 +08:00