llama.cpp/vulkan-shaders
0cc4m 45c0e2e4c1
Refactor Vulkan backend to allow multiple contexts (#7961)
* Refactor Vulkan backend to allow multiple contexts

* Fix too many shader groups called validation error in llama3 on AMD and Intel GPUs

* Fix Vulkan debug build error
2024-06-23 10:21:25 +02:00
..
add.comp
argsort.comp
clamp.comp
copy.comp
dequant_f32.comp
dequant_funcs.comp
dequant_head.comp
dequant_q2_k.comp
dequant_q3_k.comp
dequant_q4_0.comp
dequant_q4_1.comp
dequant_q4_k.comp
dequant_q5_0.comp
dequant_q5_1.comp
dequant_q5_k.comp
dequant_q6_k.comp
dequant_q8_0.comp
diag_mask_inf.comp
div.comp
gelu.comp
generic_binary_head.comp
generic_head.comp
generic_unary_head.comp
get_rows.comp
get_rows_quant.comp
mul.comp
mul_mat_split_k_reduce.comp
mul_mat_vec.comp Refactor Vulkan backend to allow multiple contexts (#7961) 2024-06-23 10:21:25 +02:00
mul_mat_vec_base.comp
mul_mat_vec_nc.comp
mul_mat_vec_p021.comp
mul_mat_vec_q2_k.comp Refactor Vulkan backend to allow multiple contexts (#7961) 2024-06-23 10:21:25 +02:00
mul_mat_vec_q3_k.comp Refactor Vulkan backend to allow multiple contexts (#7961) 2024-06-23 10:21:25 +02:00
mul_mat_vec_q4_k.comp Refactor Vulkan backend to allow multiple contexts (#7961) 2024-06-23 10:21:25 +02:00
mul_mat_vec_q5_k.comp Refactor Vulkan backend to allow multiple contexts (#7961) 2024-06-23 10:21:25 +02:00
mul_mat_vec_q6_k.comp Refactor Vulkan backend to allow multiple contexts (#7961) 2024-06-23 10:21:25 +02:00
mul_mm.comp
norm.comp
relu.comp
rms_norm.comp
rope_head.comp
rope_neox.comp
rope_norm.comp
scale.comp
silu.comp
soft_max.comp
square.comp
sum_rows.comp
types.comp