happyz
/
llama.cpp
mirror of https://github.com/ggerganov/llama.cpp.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
llama.cpp/ggml/src/ggml-sycl
History
Akarshan Biswas 8b69686136
SYCL: fix rms_norm_mul_add for tensor dim not a multiple of sg_size (#15592) 
The original implementation unconditionally returned true for this operation, leading to a failure when the tensor's first dimension (ne[0]) was not a multiple of WARP_SIZE. This caused an GGML_ASSERT(ncols % WARP_SIZE == 0) failure in ggml-sycl/norm.cpp.

This change updates the ggml_backend_sycl_device_supports_op check to correctly return true for GGML_OP_RMS_NORM only when the first dimension of the tensor is a multiple of WARP_SIZE, ensuring the operation can be performed without error.
 		2025-08-27 00:27:49 +05:30
..
dpct sycl: add usage of enqueue_functions extension (#14244) 2025-06-20 15:07:21 +02:00
CMakeLists.txt SYCL: Bump oneMath commit (#14152) 2025-06-13 08:45:37 +01:00
backend.hpp sycl: refactor quantization to q8_1 (#14815) 2025-07-28 11:05:53 +01:00
binbcast.cpp sycl: add usage of enqueue_functions extension (#14244) 2025-06-20 15:07:21 +02:00
binbcast.hpp SYCL: Refactor and enable FP16 in binary broadcast OPs (#12975) 2025-04-18 15:57:56 +02:00
common.cpp SYCL: Remove misleading ggml_sycl_op_flatten function (#12387) 2025-03-31 11:25:24 +02:00
common.hpp sycl: GGML_SYCL_DISABLE_OPT on by default for all Intel Devices (#13973) 2025-06-25 18:09:55 +02:00
concat.cpp sycl: add usage of enqueue_functions extension (#14244) 2025-06-20 15:07:21 +02:00
concat.hpp SYCL: Refactor ggml_sycl_compute_forward (#11121) 2025-01-10 08:13:03 +08:00
conv.cpp sycl: add usage of enqueue_functions extension (#14244) 2025-06-20 15:07:21 +02:00
conv.hpp SYCL: Refactor ggml_sycl_compute_forward (#11121) 2025-01-10 08:13:03 +08:00
convert.cpp sycl: add usage of enqueue_functions extension (#14244) 2025-06-20 15:07:21 +02:00
convert.hpp sycl: addressing non-contiguous src1 mul_mats (nc and batched) (#13343) 2025-05-08 10:08:01 +01:00
cpy.cpp SYCL: Add set_rows support for quantized types (#14883) 2025-07-28 20:32:15 +05:30
cpy.hpp SYCL: Add set_rows support for quantized types (#14883) 2025-07-28 20:32:15 +05:30
dequantize.hpp sycl: Add reorder to Q6_K mmvq implementation (#13885) 2025-06-09 11:47:07 +02:00
dmmv.cpp sycl: add usage of enqueue_functions extension (#14244) 2025-06-20 15:07:21 +02:00
dmmv.hpp llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
element_wise.cpp ggml : implement GEGLU_ERF and GEGLU_QUICK ops (#14445) 2025-07-03 23:07:22 +02:00
element_wise.hpp ggml : implement GEGLU_ERF and GEGLU_QUICK ops (#14445) 2025-07-03 23:07:22 +02:00
gemm.hpp sycl: Batched mulmat rework for oneDNN dispatch (#14617) 2025-07-14 10:37:35 +01:00
getrows.cpp sycl: add usage of enqueue_functions extension (#14244) 2025-06-20 15:07:21 +02:00
getrows.hpp SYCL: Remove misleading ggml_sycl_op_flatten function (#12387) 2025-03-31 11:25:24 +02:00
ggml-sycl.cpp SYCL: fix rms_norm_mul_add for tensor dim not a multiple of sg_size (#15592) 2025-08-27 00:27:49 +05:30
gla.cpp sycl: add usage of enqueue_functions extension (#14244) 2025-06-20 15:07:21 +02:00
gla.hpp SYCL: Add gated linear attention kernel (#11175) 2025-01-15 11:20:17 +08:00
im2col.cpp sycl: Fix im2col (#14797) 2025-07-21 18:39:29 +02:00
im2col.hpp SYCL: Remove misleading ggml_sycl_op_flatten function (#12387) 2025-03-31 11:25:24 +02:00
mmq.cpp sycl: add usage of enqueue_functions extension (#14244) 2025-06-20 15:07:21 +02:00
mmq.hpp llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
mmvq.cpp sycl: add usage of enqueue_functions extension (#14244) 2025-06-20 15:07:21 +02:00
mmvq.hpp llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
norm.cpp sycl: add usage of enqueue_functions extension (#14244) 2025-06-20 15:07:21 +02:00
norm.hpp SYCL: Remove misleading ggml_sycl_op_flatten function (#12387) 2025-03-31 11:25:24 +02:00
outprod.cpp sycl: Add more debug prints (#13640) 2025-05-26 10:28:53 +02:00
outprod.hpp SYCL: Refactor ggml_sycl_compute_forward (#11121) 2025-01-10 08:13:03 +08:00
presets.hpp Optimize RWKV6 Operator Naming and Implement Multi-core CPU/ SYCL Acceleration (#10133) 2024-11-07 15:19:10 +08:00
quantize.hpp sycl: refactor quantization to q8_1 (#14815) 2025-07-28 11:05:53 +01:00
quants.hpp sycl: fixed semantics of block offset calculation (#14814) 2025-07-24 11:09:57 +01:00
rope.cpp cuda : fix rope with partial rotation and non-cont src (#14580) 2025-07-08 10:15:21 +03:00
rope.hpp SYCL: Add non-contiguous support in ROPE (#12993) 2025-04-21 19:13:30 +05:30
set_rows.cpp SYCL: Add set_rows support for quantized types (#14883) 2025-07-28 20:32:15 +05:30
set_rows.hpp SYCL: Initial set_rows kernel implementation (#14562) 2025-07-10 09:29:38 +01:00
softmax.cpp sycl: add usage of enqueue_functions extension (#14244) 2025-06-20 15:07:21 +02:00
softmax.hpp SYCL : SOFTMAX F16 mask support and other fixes (#11261) 2025-01-28 09:56:58 +00:00
sycl_hw.cpp sycl: GGML_SYCL_DISABLE_OPT on by default for all Intel Devices (#13973) 2025-06-25 18:09:55 +02:00
sycl_hw.hpp sycl: GGML_SYCL_DISABLE_OPT on by default for all Intel Devices (#13973) 2025-06-25 18:09:55 +02:00
tsembd.cpp sycl: add usage of enqueue_functions extension (#14244) 2025-06-20 15:07:21 +02:00
tsembd.hpp SYCL: Refactor ggml_sycl_compute_forward (#11121) 2025-01-10 08:13:03 +08:00
vecdotq.hpp sycl: fixed semantics of block offset calculation (#14814) 2025-07-24 11:09:57 +01:00
wkv.cpp sycl: add usage of enqueue_functions extension (#14244) 2025-06-20 15:07:21 +02:00
wkv.hpp llama: Add support for RWKV v7 architecture (#12412) 2025-03-18 07:27:50 +08:00