llama.cpp

Commit Graph

Author	SHA1	Message	Date
Neo Zhang Jianyu	b260213755	[SYCL] refactor soft_max, add soft_max_back (#16472 ) * refactor to support soft_max_ext * fix error and support soft_max_back * rm unused functions * fix format issue --------- Co-authored-by: Zhang Jianyu <zhang.jianyu@outlook.com>	2025-10-09 10:25:11 +03:00
Akarshan Biswas	6e84b0ab8e	SYCL : SOFTMAX F16 mask support and other fixes (#11261 ) Implemented ggml_sycl_op_soft_max() F16 src1(mask) support for which a pragma deprecation warning was added during #5021. To do this, had to decouple it from ggml_sycl_op_flatten which always considered src1 to be of fp32 type(many OP functions are dependent on it). * SYCL: SOFTMAX F16 mask support and other fixes * test-backend-ops: Add F16 mask test cases	2025-01-28 09:56:58 +00:00
luoyu-intel	a9554e20b6	[SYCL] Fix WARP_SIZE=16 bug of Intel GPU (#8266 ) * fix group_norm ut * split softmax * fix softmax * add concat support condition * revert debug code * move QK_WARP_SIZE to presets.hpp	2024-07-05 13:06:13 +08:00

Author

SHA1

Message

Date

Neo Zhang Jianyu

b260213755

[SYCL] refactor soft_max, add soft_max_back (#16472 )

* refactor to support soft_max_ext

* fix error and support soft_max_back

* rm unused functions

* fix format issue

---------

Co-authored-by: Zhang Jianyu <zhang.jianyu@outlook.com>

2025-10-09 10:25:11 +03:00

Akarshan Biswas

6e84b0ab8e

SYCL : SOFTMAX F16 mask support and other fixes (#11261 )

Implemented ggml_sycl_op_soft_max() F16 src1(mask) support for which a pragma deprecation warning was added during #5021.
To do this, had to decouple it from ggml_sycl_op_flatten which always considered src1 to be of fp32 type(many OP functions are dependent on it).

* SYCL: SOFTMAX F16 mask support and other fixes

* test-backend-ops: Add F16 mask test cases

2025-01-28 09:56:58 +00:00

luoyu-intel

a9554e20b6

[SYCL] Fix WARP_SIZE=16 bug of Intel GPU (#8266 )

* fix group_norm ut

* split softmax

* fix softmax

* add concat support condition

* revert debug code

* move QK_WARP_SIZE to presets.hpp

2024-07-05 13:06:13 +08:00

3 Commits