happyz
/
llama.cpp
mirror of https://github.com/ggerganov/llama.cpp.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
llama.cpp/ggml/src/ggml-sycl
History
JJJYmmm d261223d24
model: add support for qwen3vl series (#16780) 
* support qwen3vl series.

Co-authored-by: Thireus ☠ <Thireus@users.noreply.github.com>
Co-authored-by: yairpatch <yairpatch@users.noreply.github.com>
Co-authored-by: LETS-BEE <LETS-BEE@users.noreply.github.com>

* bugfix: fix the arch check for qwen3vl-moe.

* use build_ffn

* optimize deepstack structure

* optimize deepstack feature saving

* Revert "optimize deepstack feature saving" for temporal fix

This reverts commit f321b9fdf1.

* code clean

* use fused qkv in clip

* clean up / rm is_deepstack_layers for simplification

* add test model

* move test model to "big" section

* fix imrope check

* remove trailing whitespace

* fix rope fail

* metal : add imrope support

* add imrope support for sycl

* vulkan: add imrope w/o check

* fix vulkan

* webgpu: add imrope w/o check

* Update gguf-py/gguf/tensor_mapping.py

Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>

* fix tensor mapping

---------

Co-authored-by: Thireus ☠ <Thireus@users.noreply.github.com>
Co-authored-by: yairpatch <yairpatch@users.noreply.github.com>
Co-authored-by: LETS-BEE <LETS-BEE@users.noreply.github.com>
Co-authored-by: Xuan Son Nguyen <son@huggingface.co>
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>
 		2025-10-30 16:19:14 +01:00
..
dpct [SYCL] refactor soft_max, add soft_max_back (#16472) 2025-10-09 10:25:11 +03:00
CMakeLists.txt SYCL: Bump oneMath commit (#14152) 2025-06-13 08:45:37 +01:00
backend.hpp sycl: add SSM_CONV operation support (#16800) 2025-10-28 09:50:33 +08:00
binbcast.cpp [SYCL] fix UT fault cases: count-equal, argsort, pad OPs (#16521) 2025-10-12 21:53:35 +08:00
binbcast.hpp [SYCL] fix UT fault cases: count-equal, argsort, pad OPs (#16521) 2025-10-12 21:53:35 +08:00
common.cpp SYCL: Remove misleading ggml_sycl_op_flatten function (#12387) 2025-03-31 11:25:24 +02:00
common.hpp [SYCL] fix UT fault cases: count-equal, argsort, pad OPs (#16521) 2025-10-12 21:53:35 +08:00
concat.cpp Revert "sycl: add usage of enqueue_functions extension (#14244)" (#15910) 2025-09-12 09:15:12 +08:00
concat.hpp SYCL: Refactor ggml_sycl_compute_forward (#11121) 2025-01-10 08:13:03 +08:00
conv.cpp Revert "sycl: add usage of enqueue_functions extension (#14244)" (#15910) 2025-09-12 09:15:12 +08:00
conv.hpp SYCL: Refactor ggml_sycl_compute_forward (#11121) 2025-01-10 08:13:03 +08:00
convert.cpp Revert "sycl: add usage of enqueue_functions extension (#14244)" (#15910) 2025-09-12 09:15:12 +08:00
convert.hpp sycl: addressing non-contiguous src1 mul_mats (nc and batched) (#13343) 2025-05-08 10:08:01 +01:00
count-equal.cpp [SYCL] fix UT fault cases: count-equal, argsort, pad OPs (#16521) 2025-10-12 21:53:35 +08:00
count-equal.hpp [SYCL] fix UT fault cases: count-equal, argsort, pad OPs (#16521) 2025-10-12 21:53:35 +08:00
cpy.cpp Revert "sycl: add usage of enqueue_functions extension (#14244)" (#15910) 2025-09-12 09:15:12 +08:00
cpy.hpp SYCL: Add set_rows support for quantized types (#14883) 2025-07-28 20:32:15 +05:30
dequantize.hpp sycl: Add reorder to Q6_K mmvq implementation (#13885) 2025-06-09 11:47:07 +02:00
dmmv.cpp Revert "sycl: add usage of enqueue_functions extension (#14244)" (#15910) 2025-09-12 09:15:12 +08:00
dmmv.hpp llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
element_wise.cpp SYCL: Add support for FLOOR,CEIL,ROUND and TRUNC unary operators (#16613) 2025-10-20 11:08:32 +03:00
element_wise.hpp SYCL: Add support for FLOOR,CEIL,ROUND and TRUNC unary operators (#16613) 2025-10-20 11:08:32 +03:00
gemm.hpp sycl: Batched mulmat rework for oneDNN dispatch (#14617) 2025-07-14 10:37:35 +01:00
getrows.cpp Revert "sycl: add usage of enqueue_functions extension (#14244)" (#15910) 2025-09-12 09:15:12 +08:00
getrows.hpp SYCL: Remove misleading ggml_sycl_op_flatten function (#12387) 2025-03-31 11:25:24 +02:00
ggml-sycl.cpp sycl: add RMS_NORM_BACK operation support (#16808) 2025-10-29 14:14:39 +08:00
gla.cpp Revert "sycl: add usage of enqueue_functions extension (#14244)" (#15910) 2025-09-12 09:15:12 +08:00
gla.hpp SYCL: Add gated linear attention kernel (#11175) 2025-01-15 11:20:17 +08:00
im2col.cpp Revert "sycl: add usage of enqueue_functions extension (#14244)" (#15910) 2025-09-12 09:15:12 +08:00
im2col.hpp SYCL: Remove misleading ggml_sycl_op_flatten function (#12387) 2025-03-31 11:25:24 +02:00
mmq.cpp Revert "sycl: add usage of enqueue_functions extension (#14244)" (#15910) 2025-09-12 09:15:12 +08:00
mmq.hpp llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
mmvq.cpp Revert "sycl: add usage of enqueue_functions extension (#14244)" (#15910) 2025-09-12 09:15:12 +08:00
mmvq.hpp llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
norm.cpp sycl: add RMS_NORM_BACK operation support (#16808) 2025-10-29 14:14:39 +08:00
norm.hpp sycl: add RMS_NORM_BACK operation support (#16808) 2025-10-29 14:14:39 +08:00
outprod.cpp sycl: Add more debug prints (#13640) 2025-05-26 10:28:53 +02:00
outprod.hpp SYCL: Refactor ggml_sycl_compute_forward (#11121) 2025-01-10 08:13:03 +08:00
pad.cpp [SYCL] fix UT fault cases: count-equal, argsort, pad OPs (#16521) 2025-10-12 21:53:35 +08:00
pad.hpp [SYCL] fix UT fault cases: count-equal, argsort, pad OPs (#16521) 2025-10-12 21:53:35 +08:00
pad_reflect_1d.cpp sycl : add PAD_REFLECT_D1 operator support (#16145) 2025-10-21 00:21:12 +02:00
pad_reflect_1d.hpp sycl : add PAD_REFLECT_D1 operator support (#16145) 2025-10-21 00:21:12 +02:00
presets.hpp SYCL SET operator optimized for F32 tensors (#16350) 2025-10-17 10:36:40 +08:00
quantize.hpp sycl: refactor quantization to q8_1 (#14815) 2025-07-28 11:05:53 +01:00
quants.hpp sycl: fixed semantics of block offset calculation (#14814) 2025-07-24 11:09:57 +01:00
repeat_back.cpp sycl: add REPEAT_BACK operation support (#16734) 2025-10-27 09:19:50 +08:00
repeat_back.hpp sycl: add REPEAT_BACK operation support (#16734) 2025-10-27 09:19:50 +08:00
roll.cpp sycl: add ROLL operation support (#16665) 2025-10-27 09:20:24 +08:00
roll.hpp sycl: add ROLL operation support (#16665) 2025-10-27 09:20:24 +08:00
rope.cpp model: add support for qwen3vl series (#16780) 2025-10-30 16:19:14 +01:00
rope.hpp SYCL: Add non-contiguous support in ROPE (#12993) 2025-04-21 19:13:30 +05:30
set.cpp SYCL SET operator optimized for F32 tensors (#16350) 2025-10-17 10:36:40 +08:00
set.hpp SYCL SET operator optimized for F32 tensors (#16350) 2025-10-17 10:36:40 +08:00
set_rows.cpp ggml : implement set_rows with i32 index (#16159) 2025-09-22 19:13:00 +02:00
set_rows.hpp SYCL: Initial set_rows kernel implementation (#14562) 2025-07-10 09:29:38 +01:00
softmax.cpp [SYCL] refactor soft_max, add soft_max_back (#16472) 2025-10-09 10:25:11 +03:00
softmax.hpp [SYCL] refactor soft_max, add soft_max_back (#16472) 2025-10-09 10:25:11 +03:00
ssm_conv.cpp sycl: add SSM_CONV operation support (#16800) 2025-10-28 09:50:33 +08:00
ssm_conv.hpp sycl: add SSM_CONV operation support (#16800) 2025-10-28 09:50:33 +08:00
sycl_hw.cpp sycl: GGML_SYCL_DISABLE_OPT on by default for all Intel Devices (#13973) 2025-06-25 18:09:55 +02:00
sycl_hw.hpp sycl: GGML_SYCL_DISABLE_OPT on by default for all Intel Devices (#13973) 2025-06-25 18:09:55 +02:00
tsembd.cpp ggml : fix padding in timestep embedding kernels (#15932) 2025-09-16 15:25:57 +02:00
tsembd.hpp SYCL: Refactor ggml_sycl_compute_forward (#11121) 2025-01-10 08:13:03 +08:00
vecdotq.hpp sycl: fixed semantics of block offset calculation (#14814) 2025-07-24 11:09:57 +01:00
wkv.cpp Revert "sycl: add usage of enqueue_functions extension (#14244)" (#15910) 2025-09-12 09:15:12 +08:00
wkv.hpp llama: Add support for RWKV v7 architecture (#12412) 2025-03-18 07:27:50 +08:00