happyz
/
llama.cpp
mirror of https://github.com/ggerganov/llama.cpp.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
llama.cpp/ggml/src/ggml-sycl
History
xctan f470bc36be
ggml-cpu : split arch-specific implementations (#13892) 
* move ggml-cpu-aarch64 to repack

* split quantize_row_q8_0/1

* split helper functions

* split ggml_vec_dot_q4_0_q8_0

* split ggml_vec_dot_q4_1_q8_1

* split ggml_vec_dot_q5_0_q8_0

* split ggml_vec_dot_q5_1_q8_1

* split ggml_vec_dot_q8_0_q8_0

* split ggml_vec_dot_tq1_0_q8_K

* split ggml_vec_dot_tq2_0_q8_K

* split ggml_vec_dot_q2_K_q8_K

* split ggml_vec_dot_q3_K_q8_K

* split ggml_vec_dot_q4_K_q8_K

* split ggml_vec_dot_q5_K_q8_K

* split ggml_vec_dot_q6_K_q8_K

* split ggml_vec_dot_iq2_xxs_q8_K

* split ggml_vec_dot_iq2_xs_q8_K

* split ggml_vec_dot_iq2_s_q8_K

* split ggml_vec_dot_iq3_xxs_q8_K

* split ggml_vec_dot_iq3_s_q8_K

* split ggml_vec_dot_iq1_s_q8_K

* split ggml_vec_dot_iq1_m_q8_K

* split ggml_vec_dot_iq4_nl_q8_0

* split ggml_vec_dot_iq4_xs_q8_K

* fix typos

* fix missing prototypes

* rename ggml-cpu-quants.c

* rename ggml-cpu-traits

* rename arm folder

* move cpu-feats-x86.cpp

* rename ggml-cpu-hbm

* update arm detection macro in quants.c

* move iq quant tables

* split ggml_quantize_mat_q8_0/K

* split ggml_gemv_*

* split ggml_gemm_*

* rename namespace aarch64 to repack

* use weak aliases to replace test macros

* rename GGML_CPU_AARCH64 to GGML_CPU_REPACK

* rename more aarch64 to repack

* clean up rebase leftover

* fix compilation errors

* remove trailing spaces

* try to fix clang compilation errors

* try to fix clang compilation errors again

* try to fix clang compilation errors, 3rd attempt

* try to fix clang compilation errors, 4th attempt

* try to fix clang compilation errors, 5th attempt

* try to fix clang compilation errors, 6th attempt

* try to fix clang compilation errors, 7th attempt

* try to fix clang compilation errors, 8th attempt

* try to fix clang compilation errors, 9th attempt

* more cleanup

* fix compilation errors

* fix apple targets

* fix a typo in arm version of ggml_vec_dot_q4_K_q8_K

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
 		2025-06-09 16:47:13 +02:00
..
dpct SYCL: Rename oneMKL to oneMath (#12192) 2025-04-01 16:24:29 +08:00
CMakeLists.txt cmake : Fix broken CMake error messages (ggml/1252) 2025-06-01 13:43:57 +03:00
backend.hpp sycl : implementation of reordered Q4_0 MMVQ for Intel GPUs (#12858) 2025-05-09 16:34:08 +01:00
binbcast.cpp sycl: Add more debug prints (#13640) 2025-05-26 10:28:53 +02:00
binbcast.hpp SYCL: Refactor and enable FP16 in binary broadcast OPs (#12975) 2025-04-18 15:57:56 +02:00
common.cpp SYCL: Remove misleading ggml_sycl_op_flatten function (#12387) 2025-03-31 11:25:24 +02:00
common.hpp ggml-cpu : split arch-specific implementations (#13892) 2025-06-09 16:47:13 +02:00
concat.cpp sycl: Add more debug prints (#13640) 2025-05-26 10:28:53 +02:00
concat.hpp SYCL: Refactor ggml_sycl_compute_forward (#11121) 2025-01-10 08:13:03 +08:00
conv.cpp sycl: Add more debug prints (#13640) 2025-05-26 10:28:53 +02:00
conv.hpp SYCL: Refactor ggml_sycl_compute_forward (#11121) 2025-01-10 08:13:03 +08:00
convert.cpp sycl: Add reorder to Q6_K mmvq implementation (#13885) 2025-06-09 11:47:07 +02:00
convert.hpp sycl: addressing non-contiguous src1 mul_mats (nc and batched) (#13343) 2025-05-08 10:08:01 +01:00
cpy.cpp SYCL: Implement few same quantized type copy kernels (#13739) 2025-06-07 18:58:20 +05:30
cpy.hpp SYCL: Move CPY kernels to a separate file and add few missing kernels (#12133) 2025-03-03 11:07:22 +01:00
dequantize.hpp sycl: Add reorder to Q6_K mmvq implementation (#13885) 2025-06-09 11:47:07 +02:00
dmmv.cpp sycl: Add more debug prints (#13640) 2025-05-26 10:28:53 +02:00
dmmv.hpp llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
element_wise.cpp SYCL: add gelu_erf kernel (#13749) 2025-05-27 20:52:59 +05:30
element_wise.hpp SYCL: add gelu_erf kernel (#13749) 2025-05-27 20:52:59 +05:30
gemm.hpp sycl: use oneDNN for matrices multiplication (#12972) 2025-05-15 16:53:41 +02:00
getrows.cpp sycl: Add more debug prints (#13640) 2025-05-26 10:28:53 +02:00
getrows.hpp SYCL: Remove misleading ggml_sycl_op_flatten function (#12387) 2025-03-31 11:25:24 +02:00
ggml-sycl.cpp sycl: Add reorder to Q6_K mmvq implementation (#13885) 2025-06-09 11:47:07 +02:00
gla.cpp sycl: Add more debug prints (#13640) 2025-05-26 10:28:53 +02:00
gla.hpp SYCL: Add gated linear attention kernel (#11175) 2025-01-15 11:20:17 +08:00
im2col.cpp SYCL: Fix im2col (#12910) 2025-04-14 14:23:53 +02:00
im2col.hpp SYCL: Remove misleading ggml_sycl_op_flatten function (#12387) 2025-03-31 11:25:24 +02:00
mmq.cpp fixed compilation warnings in ggml-sycl (#12424) 2025-03-18 08:51:25 +08:00
mmq.hpp llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
mmvq.cpp sycl: Add reorder to Q6_K mmvq implementation (#13885) 2025-06-09 11:47:07 +02:00
mmvq.hpp llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
norm.cpp SYCL: Add non contiguous support in RMS_NORM and NORM kernels (#13611) 2025-05-26 21:10:36 +05:30
norm.hpp SYCL: Remove misleading ggml_sycl_op_flatten function (#12387) 2025-03-31 11:25:24 +02:00
outprod.cpp sycl: Add more debug prints (#13640) 2025-05-26 10:28:53 +02:00
outprod.hpp SYCL: Refactor ggml_sycl_compute_forward (#11121) 2025-01-10 08:13:03 +08:00
presets.hpp Optimize RWKV6 Operator Naming and Implement Multi-core CPU/ SYCL Acceleration (#10133) 2024-11-07 15:19:10 +08:00
quants.hpp sycl: Add reorder to Q6_K mmvq implementation (#13885) 2025-06-09 11:47:07 +02:00
rope.cpp SYCL: Add mrope kernel (#13755) 2025-05-30 19:40:57 +05:30
rope.hpp SYCL: Add non-contiguous support in ROPE (#12993) 2025-04-21 19:13:30 +05:30
softmax.cpp sycl: Add more debug prints (#13640) 2025-05-26 10:28:53 +02:00
softmax.hpp SYCL : SOFTMAX F16 mask support and other fixes (#11261) 2025-01-28 09:56:58 +00:00
sycl_hw.cpp [SYCL] Optimize mul_mat for Q4_0 on Intel GPU (#12035) 2025-02-24 22:33:23 +08:00
sycl_hw.hpp [SYCL] Optimize mul_mat for Q4_0 on Intel GPU (#12035) 2025-02-24 22:33:23 +08:00
tsembd.cpp sycl: Add more debug prints (#13640) 2025-05-26 10:28:53 +02:00
tsembd.hpp SYCL: Refactor ggml_sycl_compute_forward (#11121) 2025-01-10 08:13:03 +08:00
vecdotq.hpp sycl: Add reorder to Q6_K mmvq implementation (#13885) 2025-06-09 11:47:07 +02:00
wkv.cpp sycl: Add more debug prints (#13640) 2025-05-26 10:28:53 +02:00
wkv.hpp llama: Add support for RWKV v7 architecture (#12412) 2025-03-18 07:27:50 +08:00