happyz
/
llama.cpp
mirror of https://github.com/ggerganov/llama.cpp.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
llama.cpp/ggml/src/ggml-cann
History
hipudding 1af9dab32b
CANN: add BF16 support for core operators (#20152) 
* CANN: add BF16 support for core operators

Add BF16 (bfloat16) type support to the CANN backend for the following
operators: MUL_MAT, MUL_MAT_ID, GET_ROWS, SET_ROWS, CPY, CONT, and
OUT_PROD. This enables BF16 models to run on Ascend NPUs.

* CANN: skip NZ weight format for BF16 and add 310P compile guards

NZ weight format conversion does not support BF16 tensors, skip it
in set_tensor, get_alloc_size and mul_mat. Remove BF16 from MUL_MAT_ID
and OUT_PROD as there are no BF16 use cases. Add #ifndef ASCEND_310P
guards for all BF16 operator support since 310P does not support BF16.
 		2026-03-20 17:08:39 +08:00
..
CMakeLists.txt CANN: add support for ACL Graph (#15065) 2025-08-06 14:12:42 +08:00
acl_tensor.cpp docs : Minor cleanups (#19252) 2026-02-02 08:38:55 +02:00
acl_tensor.h docs : Minor cleanups (#19252) 2026-02-02 08:38:55 +02:00
aclnn_ops.cpp CANN: add BF16 support for core operators (#20152) 2026-03-20 17:08:39 +08:00
aclnn_ops.h docs : Minor cleanups (#19252) 2026-02-02 08:38:55 +02:00
common.h docs : Minor cleanups (#19252) 2026-02-02 08:38:55 +02:00
ggml-cann.cpp CANN: add BF16 support for core operators (#20152) 2026-03-20 17:08:39 +08:00