llama.cpp/ggml
hongyang 2f3dfe2e74 ggml : block interleaving support for Q4_K quanti for AArch64
* new quanti: block_q4_kx4 with offline repack impl

* new quantize path: neon impl for ggml_quantize_mat_q8_K_4x8

* new gemv kernel: ggml_gemv_q4_K_4x8_q8_K based on dotprod

* new gemm kernel: ggml_gemm_q4_K_4x8_q8_K based on i8mm

* performance boost for both S_PP and S_TG

---------

Co-authored-by: yuanjia111 <yuan.jia@sanechips.com.cn>
2025-12-18 14:14:10 +08:00
..
cmake ggml: Skip backend library linking code when GGML_BACKEND_DL=ON (#15094) 2025-08-07 13:45:41 +02:00
include llama: automatically set parameters not set by the user in such a way that maximizes GPU utilization (#16653) 2025-12-15 09:24:59 +01:00
src ggml : block interleaving support for Q4_K quanti for AArch64 2025-12-18 14:14:10 +08:00
.gitignore vulkan : cmake integration (#8119) 2024-07-13 18:12:39 +02:00
CMakeLists.txt cmake : set `CMAKE_RUNTIME_OUTPUT_DIRECTORY` for non standalone build (ggml/1394) 2025-12-14 08:33:51 +02:00