Chenguang Li 1e7489745a CANN: refactor mask handling and improve performance in FA (#15561) ... * CANN(flash-attn): refactor mask handling and improve performance 1. Refactored the mask computation in Flash Attention, unified the logic without separating prefill and decode. 2. Optimized performance in non-alibi scenarios by reducing one repeat operation. 3. Updated operator management to explicitly mark unsupported cases on 310P devices and when dim is not divisible by 16. Signed-off-by: noemotiovon <757486878@qq.com> * [CANN]: fix review Signed-off-by: noemotiovon <757486878@qq.com> * [CANN]: Optimization FA BNSD to BSND Signed-off-by: noemotiovon <757486878@qq.com> --------- Signed-off-by: noemotiovon <757486878@qq.com>		2025-08-27 17:21:41 +08:00
..
ggml-blas	ggml : fix field name when new ggml_backend (#14944)	2025-08-08 14:37:22 +02:00
ggml-cann	CANN: refactor mask handling and improve performance in FA (#15561)	2025-08-27 17:21:41 +08:00
ggml-cpu	ggml-cpu : add basic RVV support for vector f32 ops (#15057)	2025-08-27 16:44:22 +08:00
ggml-cuda	CUDA: return -1 for nonexistent compiled arch (#15587)	2025-08-26 16:01:20 +02:00
ggml-hip	HIP: bump requirement to rocm 6.1 (#15296)	2025-08-13 20:44:30 +02:00
ggml-metal	metal : optimize FA vec for large sequences and BS <= 8 (#15566)	2025-08-26 14:22:14 +03:00
ggml-musa	CUDA: replace GGML_CUDA_F16 with CUDA arch checks (#15433)	2025-08-20 16:58:49 +02:00
ggml-opencl	OpenCL: add fused group_norm/norm, mul, add (#15314)	2025-08-26 23:36:05 -07:00
ggml-rpc	ggml-rpc: chunk send()/recv() to avoid EINVAL for very large tensors over RPC (macOS & others) (#15188)	2025-08-13 08:54:30 +03:00
ggml-sycl	SYCL: fix rms_norm_mul_add for tensor dim not a multiple of sg_size (#15592)	2025-08-27 00:27:49 +05:30
ggml-vulkan	vulkan: Remove splitting for mul_mat_id (#15568)	2025-08-26 06:42:44 +02:00
ggml-webgpu	ggml WebGPU: add support for quantization types (#15440)	2025-08-22 11:28:03 -07:00
ggml-zdnn	ggml: initial IBM zDNN backend (#14975)	2025-08-15 21:11:22 +08:00
CMakeLists.txt	ggml: initial IBM zDNN backend (#14975)	2025-08-15 21:11:22 +08:00
ggml-alloc.c	llama : add gpt-oss (#15091)	2025-08-05 22:10:36 +03:00
ggml-backend-impl.h	ggml : upgrade init_tensor API to return a ggml_status (#11854)	2025-02-28 14:41:47 +01:00
ggml-backend-reg.cpp	ggml: initial IBM zDNN backend (#14975)	2025-08-15 21:11:22 +08:00
ggml-backend.cpp	sched : fix possible use of wrong ids tensor when offloading moe prompt processing (#15488)	2025-08-21 23:09:32 +02:00
ggml-common.h	llama : add gpt-oss (#15091)	2025-08-05 22:10:36 +03:00
ggml-impl.h	llama : add gpt-oss (#15091)	2025-08-05 22:10:36 +03:00
ggml-opt.cpp	finetune: SGD optimizer, more CLI args (#13873)	2025-08-14 12:03:57 +02:00
ggml-quants.c	ggml-quants : fix make_qp_quants NANs and IQ1 assertion errors (#15379)	2025-08-18 09:23:56 +02:00
ggml-quants.h	llama : add gpt-oss (#15091)	2025-08-05 22:10:36 +03:00
ggml-threading.cpp	ggml : build backends as libraries (#10256)	2024-11-14 18:04:35 +01:00
ggml-threading.h	remove CMAKE_WINDOWS_EXPORT_ALL_SYMBOLS (#10797)	2024-12-12 19:02:49 +01:00
ggml.c	ggml: add `conv3d` op (#15182)	2025-08-22 15:33:15 +02:00
ggml.cpp	ggml : Print backtrace on uncaught C++ exceptions (ggml/1232)	2025-06-01 13:43:57 +03:00
gguf.cpp	ggml : prevent integer overflow in gguf tensor size calculation (#14595)	2025-07-09 14:33:53 +02:00