hipudding 5624c99bd3 CANN: implement quantized MUL_MAT_ID for MoE models ... Implement ggml_cann_mul_mat_id_quant function to support quantized matrix multiplication for Mixture of Experts (MoE) architectures on CANN backend. Key features: - Support Q4_0 and Q8_0 quantized weight formats - Use IndexSelect to dynamically route expert-specific weights based on indices - Leverage WeightQuantBatchMatmulV2 for efficient quantized computation - Handle automatic F16 type conversion for hardware compatibility - Support both per-expert and broadcast input modes Implementation details: - Extract expert weights and scales using CANN IndexSelect operation - Process each batch and expert combination independently - Create proper tensor views with correct stride for matmul operations - Automatic input/output type casting to/from F16 as needed Testing: All test cases passed for supported types (F32, F16, Q4_0, Q8_0).		2026-02-04 08:36:07 +00:00
..
cmake	ggml: Skip backend library linking code when GGML_BACKEND_DL=ON (#15094)	2025-08-07 13:45:41 +02:00
include	ggml-virtgpu: make the code thread safe (#19204)	2026-02-04 10:46:18 +08:00
src	CANN: implement quantized MUL_MAT_ID for MoE models	2026-02-04 08:36:07 +00:00
.gitignore	vulkan : cmake integration (#8119)	2024-07-13 18:12:39 +02:00
CMakeLists.txt	Bump cmake max version (needed for Windows on Snapdragon builds) (#19188)	2026-02-01 14:13:38 -08:00