Chenguang Li 1e7489745a CANN: refactor mask handling and improve performance in FA (#15561) ... * CANN(flash-attn): refactor mask handling and improve performance 1. Refactored the mask computation in Flash Attention, unified the logic without separating prefill and decode. 2. Optimized performance in non-alibi scenarios by reducing one repeat operation. 3. Updated operator management to explicitly mark unsupported cases on 310P devices and when dim is not divisible by 16. Signed-off-by: noemotiovon <757486878@qq.com> * [CANN]: fix review Signed-off-by: noemotiovon <757486878@qq.com> * [CANN]: Optimization FA BNSD to BSND Signed-off-by: noemotiovon <757486878@qq.com> --------- Signed-off-by: noemotiovon <757486878@qq.com>		2025-08-27 17:21:41 +08:00
..
cmake	ggml: Skip backend library linking code when GGML_BACKEND_DL=ON (#15094)	2025-08-07 13:45:41 +02:00
include	ggml: add `conv3d` op (#15182)	2025-08-22 15:33:15 +02:00
src	CANN: refactor mask handling and improve performance in FA (#15561)	2025-08-27 17:21:41 +08:00
.gitignore	vulkan : cmake integration (#8119)	2024-07-13 18:12:39 +02:00
CMakeLists.txt	CUDA: replace GGML_CUDA_F16 with CUDA arch checks (#15433)	2025-08-20 16:58:49 +02:00