happyz
/
llama.cpp
mirror of https://github.com/ggerganov/llama.cpp.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
llama.cpp/ggml/src
History
R0CKSTAR c35e586ea5
musa: enable building fat binaries, enable unified memory, and disable Flash Attention on QY1 (MTT S80) (#9526) 
* mtgpu: add mp_21 support

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

* mtgpu: disable flash attention on qy1 (MTT S80); disable q3_k and mul_mat_batched_cublas

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

* mtgpu: enable unified memory

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

* mtgpu: map cublasOperation_t to mublasOperation_t (sync code to latest)

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

---------

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 		2024-09-22 16:55:49 +02:00
..
ggml-cann cann : fix doxy (ggml/0) 2024-09-08 11:05:55 +03:00
ggml-cuda musa: enable building fat binaries, enable unified memory, and disable Flash Attention on QY1 (MTT S80) (#9526) 2024-09-22 16:55:49 +02:00
ggml-sycl [SYCL] Fix DMMV dequantization (#9279) 2024-09-04 16:26:33 +01:00
kompute@4565194ed7 llama : reorganize source code + improve CMake (#8006) 2024-06-26 18:33:02 +03:00
kompute-shaders ggml : move rope type enum to ggml.h (#8949) 2024-08-13 21:13:15 +02:00
llamafile ggml : move common CPU backend impl to new header (#9509) 2024-09-16 16:22:07 +02:00
vulkan-shaders Improve Vulkan shader build system (#9239) 2024-09-06 08:56:17 +02:00
CMakeLists.txt musa: enable building fat binaries, enable unified memory, and disable Flash Attention on QY1 (MTT S80) (#9526) 2024-09-22 16:55:49 +02:00
ggml-aarch64.c ggml : move common CPU backend impl to new header (#9509) 2024-09-16 16:22:07 +02:00
ggml-aarch64.h ggml : minor naming changes (#8433) 2024-07-12 10:46:02 +03:00
ggml-alloc.c ggml-alloc : fix list of allocated tensors with GGML_ALLOCATOR_DEBUG (#9573) 2024-09-21 14:24:23 +02:00
ggml-backend-impl.h ggml/examples: add backend support for numerical optimization (ggml/949) 2024-09-20 21:15:05 +03:00
ggml-backend.c ggml : fix trailing whitespace (#0) 2024-09-20 21:15:05 +03:00
ggml-blas.cpp ggml : hide ggml_object, ggml_cgraph, ggml_hash_set (#9408) 2024-09-12 14:23:49 +03:00
ggml-cann.cpp ggml/examples: add backend support for numerical optimization (ggml/949) 2024-09-20 21:15:05 +03:00
ggml-common.h ggml-quants : ternary packing for TriLMs and BitNet b1.58 (#8151) 2024-09-05 21:48:47 -04:00
ggml-cpu-impl.h ggml : move common CPU backend impl to new header (#9509) 2024-09-16 16:22:07 +02:00
ggml-cuda.cu musa: enable building fat binaries, enable unified memory, and disable Flash Attention on QY1 (MTT S80) (#9526) 2024-09-22 16:55:49 +02:00
ggml-impl.h ggml : move common CPU backend impl to new header (#9509) 2024-09-16 16:22:07 +02:00
ggml-kompute.cpp ggml/examples: add backend support for numerical optimization (ggml/949) 2024-09-20 21:15:05 +03:00
ggml-metal.m ggml/examples: add backend support for numerical optimization (ggml/949) 2024-09-20 21:15:05 +03:00
ggml-metal.metal sync : ggml 2024-08-27 22:41:27 +03:00
ggml-quants.c ggml : move common CPU backend impl to new header (#9509) 2024-09-16 16:22:07 +02:00
ggml-quants.h ggml-quants : ternary packing for TriLMs and BitNet b1.58 (#8151) 2024-09-05 21:48:47 -04:00
ggml-rpc.cpp ggml/examples: add backend support for numerical optimization (ggml/949) 2024-09-20 21:15:05 +03:00
ggml-sycl.cpp ggml : fix builds (#0) 2024-09-20 21:15:05 +03:00
ggml-vulkan.cpp ggml/examples: add backend support for numerical optimization (ggml/949) 2024-09-20 21:15:05 +03:00
ggml.c ggml/examples: add backend support for numerical optimization (ggml/949) 2024-09-20 21:15:05 +03:00