happyz
/
llama.cpp
mirror of https://github.com/ggerganov/llama.cpp.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
llama.cpp/ggml/src/ggml-sycl
History
Nicolò Scipione 8308f98c7f
sycl: add usage of enqueue_functions extension (#14244) 
* Add header and namespace to use enqueue_functions extension

* Convert submit and parallel_for to use new extension in convert.cpp

* Convert submit and parallel_for to use extension in ggml-sycl.cpp

* Convert submit and parallel_for to use extension in gla.cpp

* Convert submit and parallel_for in mmq.cpp

* Convert submit and parallel_for in mmvq.cpp

* Convert submit and parallel_for in remaining files

* Convert all simple parallel_for to nd_launch from enqueue_functions
extension

* Wrapping extension in general function

Create a general function that enable the enqueue_functions extension if
it is enable in the compiler, otherwise call the general SYCL function
to launch kernels.

---------

Signed-off-by: nscipione <nicolo.scipione@codeplay.com>
 		2025-06-20 15:07:21 +02:00
..
dpct sycl: add usage of enqueue_functions extension (#14244) 2025-06-20 15:07:21 +02:00
CMakeLists.txt SYCL: Bump oneMath commit (#14152) 2025-06-13 08:45:37 +01:00
backend.hpp sycl : implementation of reordered Q4_0 MMVQ for Intel GPUs (#12858) 2025-05-09 16:34:08 +01:00
binbcast.cpp sycl: add usage of enqueue_functions extension (#14244) 2025-06-20 15:07:21 +02:00
binbcast.hpp SYCL: Refactor and enable FP16 in binary broadcast OPs (#12975) 2025-04-18 15:57:56 +02:00
common.cpp SYCL: Remove misleading ggml_sycl_op_flatten function (#12387) 2025-03-31 11:25:24 +02:00
common.hpp sycl: Adding additional cpy dbg print output (#14034) 2025-06-13 08:51:39 +01:00
concat.cpp sycl: add usage of enqueue_functions extension (#14244) 2025-06-20 15:07:21 +02:00
concat.hpp SYCL: Refactor ggml_sycl_compute_forward (#11121) 2025-01-10 08:13:03 +08:00
conv.cpp sycl: add usage of enqueue_functions extension (#14244) 2025-06-20 15:07:21 +02:00
conv.hpp SYCL: Refactor ggml_sycl_compute_forward (#11121) 2025-01-10 08:13:03 +08:00
convert.cpp sycl: add usage of enqueue_functions extension (#14244) 2025-06-20 15:07:21 +02:00
convert.hpp sycl: addressing non-contiguous src1 mul_mats (nc and batched) (#13343) 2025-05-08 10:08:01 +01:00
cpy.cpp sycl: add usage of enqueue_functions extension (#14244) 2025-06-20 15:07:21 +02:00
cpy.hpp SYCL: Move CPY kernels to a separate file and add few missing kernels (#12133) 2025-03-03 11:07:22 +01:00
dequantize.hpp sycl: Add reorder to Q6_K mmvq implementation (#13885) 2025-06-09 11:47:07 +02:00
dmmv.cpp sycl: add usage of enqueue_functions extension (#14244) 2025-06-20 15:07:21 +02:00
dmmv.hpp llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
element_wise.cpp sycl: add usage of enqueue_functions extension (#14244) 2025-06-20 15:07:21 +02:00
element_wise.hpp SYCL: add gelu_erf kernel (#13749) 2025-05-27 20:52:59 +05:30
gemm.hpp sycl: Remove not needed copy f16->f32 for dnnl mul mat (#14125) 2025-06-12 15:15:11 +02:00
getrows.cpp sycl: add usage of enqueue_functions extension (#14244) 2025-06-20 15:07:21 +02:00
getrows.hpp SYCL: Remove misleading ggml_sycl_op_flatten function (#12387) 2025-03-31 11:25:24 +02:00
ggml-sycl.cpp sycl: add usage of enqueue_functions extension (#14244) 2025-06-20 15:07:21 +02:00
gla.cpp sycl: add usage of enqueue_functions extension (#14244) 2025-06-20 15:07:21 +02:00
gla.hpp SYCL: Add gated linear attention kernel (#11175) 2025-01-15 11:20:17 +08:00
im2col.cpp sycl: add usage of enqueue_functions extension (#14244) 2025-06-20 15:07:21 +02:00
im2col.hpp SYCL: Remove misleading ggml_sycl_op_flatten function (#12387) 2025-03-31 11:25:24 +02:00
mmq.cpp sycl: add usage of enqueue_functions extension (#14244) 2025-06-20 15:07:21 +02:00
mmq.hpp llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
mmvq.cpp sycl: add usage of enqueue_functions extension (#14244) 2025-06-20 15:07:21 +02:00
mmvq.hpp llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
norm.cpp sycl: add usage of enqueue_functions extension (#14244) 2025-06-20 15:07:21 +02:00
norm.hpp SYCL: Remove misleading ggml_sycl_op_flatten function (#12387) 2025-03-31 11:25:24 +02:00
outprod.cpp sycl: Add more debug prints (#13640) 2025-05-26 10:28:53 +02:00
outprod.hpp SYCL: Refactor ggml_sycl_compute_forward (#11121) 2025-01-10 08:13:03 +08:00
presets.hpp Optimize RWKV6 Operator Naming and Implement Multi-core CPU/ SYCL Acceleration (#10133) 2024-11-07 15:19:10 +08:00
quants.hpp sycl: Add reorder to Q6_K mmvq implementation (#13885) 2025-06-09 11:47:07 +02:00
rope.cpp sycl: add usage of enqueue_functions extension (#14244) 2025-06-20 15:07:21 +02:00
rope.hpp SYCL: Add non-contiguous support in ROPE (#12993) 2025-04-21 19:13:30 +05:30
softmax.cpp sycl: add usage of enqueue_functions extension (#14244) 2025-06-20 15:07:21 +02:00
softmax.hpp SYCL : SOFTMAX F16 mask support and other fixes (#11261) 2025-01-28 09:56:58 +00:00
sycl_hw.cpp [SYCL] Optimize mul_mat for Q4_0 on Intel GPU (#12035) 2025-02-24 22:33:23 +08:00
sycl_hw.hpp [SYCL] Optimize mul_mat for Q4_0 on Intel GPU (#12035) 2025-02-24 22:33:23 +08:00
tsembd.cpp sycl: add usage of enqueue_functions extension (#14244) 2025-06-20 15:07:21 +02:00
tsembd.hpp SYCL: Refactor ggml_sycl_compute_forward (#11121) 2025-01-10 08:13:03 +08:00
vecdotq.hpp sycl: Add reorder to Q6_K mmvq implementation (#13885) 2025-06-09 11:47:07 +02:00
wkv.cpp sycl: add usage of enqueue_functions extension (#14244) 2025-06-20 15:07:21 +02:00
wkv.hpp llama: Add support for RWKV v7 architecture (#12412) 2025-03-18 07:27:50 +08:00