happyz
/
llama.cpp
mirror of https://github.com/ggerganov/llama.cpp.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
llama.cpp/ggml/src
History
Jeff Bolz 6efcd65945
vulkan: optimize flash attention split_k_reduce (#14554) 
* vulkan: allow FA split_k with smaller KV values

* vulkan: spread split_k_reduce work across more threads

k_num can get rather large. Use the whole workgroup to reduce the M/L values.

Launch a thread for each element in the HSV dimension of the output. Helps a
lot for large HSV (like deepseek).
 		2025-07-08 20:11:42 +02:00
..
ggml-blas cmake : Fix broken CMake error messages (ggml/1252) 2025-06-01 13:43:57 +03:00
ggml-cann CANN: Replace aclrtMemsetSync with aclnnInplaceZero operator (#14002) 2025-07-04 11:50:07 +08:00
ggml-cpu ggml : implement GEGLU_ERF and GEGLU_QUICK ops (#14445) 2025-07-03 23:07:22 +02:00
ggml-cuda cuda : fix rope with partial rotation and non-cont src (#14580) 2025-07-08 10:15:21 +03:00
ggml-hip HIP: disable rocwmma on gfx12 by default until rocm 7.0 (#14202) 2025-06-16 13:47:38 +02:00
ggml-metal metal : disable fast math in all quantize kernels (#14528) 2025-07-04 19:19:09 +03:00
ggml-musa musa: enable fp16 mma (all) and cublas on qy2 (#13842) 2025-06-26 12:11:59 +08:00
ggml-opencl opencl: add GELU_ERF (#14476) 2025-07-04 23:24:56 -07:00
ggml-rpc rpc : nicer error messages for RPC server crash (#14076) 2025-06-10 09:41:01 +03:00
ggml-sycl cuda : fix rope with partial rotation and non-cont src (#14580) 2025-07-08 10:15:21 +03:00
ggml-vulkan vulkan: optimize flash attention split_k_reduce (#14554) 2025-07-08 20:11:42 +02:00
CMakeLists.txt ggml : remove kompute backend (#14501) 2025-07-03 07:48:32 +03:00
ggml-alloc.c ggml: Don't assert fail when tensor data changes (#13222) 2025-05-01 22:46:10 +02:00
ggml-backend-impl.h ggml : upgrade init_tensor API to return a ggml_status (#11854) 2025-02-28 14:41:47 +01:00
ggml-backend-reg.cpp ggml : remove kompute backend (#14501) 2025-07-03 07:48:32 +03:00
ggml-backend.cpp vulkan: Add fusion support for RMS_NORM+MUL (#14366) 2025-06-29 09:43:36 +02:00
ggml-common.h ggml-cpu : split arch-specific implementations (#13892) 2025-06-09 16:47:13 +02:00
ggml-impl.h vulkan: Add fusion support for RMS_NORM+MUL (#14366) 2025-06-29 09:43:36 +02:00
ggml-opt.cpp mnist: fix segmentation fault (ggml/1227) 2025-05-19 13:29:56 +03:00
ggml-quants.c ggml-quants : rename best_mad to best_error (ggml/1283) 2025-07-01 11:06:39 +03:00
ggml-quants.h ggml : build backends as libraries (#10256) 2024-11-14 18:04:35 +01:00
ggml-threading.cpp ggml : build backends as libraries (#10256) 2024-11-14 18:04:35 +01:00
ggml-threading.h remove CMAKE_WINDOWS_EXPORT_ALL_SYMBOLS (#10797) 2024-12-12 19:02:49 +01:00
ggml.c ggml : implement GEGLU_ERF and GEGLU_QUICK ops (#14445) 2025-07-03 23:07:22 +02:00
ggml.cpp ggml : Print backtrace on uncaught C++ exceptions (ggml/1232) 2025-06-01 13:43:57 +03:00
gguf.cpp ggml : do not output unprintable characters on GGUF load failure (#14381) 2025-06-25 23:26:51 +02:00