happyz
/
llama.cpp
mirror of https://github.com/ggerganov/llama.cpp.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
3,008 Commits 562 Branches 6,044 Tags 1.5 GiB
Commit Graph

3 Commits

Author SHA1 Message Date
jaime-m-p d67de1a364 Merge commit '148995e5' into tokenizer-bpe-fixes 2024-06-12 00:24:20 +02:00
Johannes Gäßler 133d99c599
CUDA: deduplicate FlashAttention code (#7352) 2024-05-18 12:36:25 +02:00
Johannes Gäßler dc685be466
CUDA: add FP32 FlashAttention vector kernel (#7188) 
* CUDA: add FP32 FlashAttention vector kernel

* fixup! CUDA: add FP32 FlashAttention vector kernel

* fixup! fixup! CUDA: add FP32 FlashAttention vector kernel

* fixup! fixup! fixup! CUDA: add FP32 FlashAttention vector kernel
 2024-05-12 19:40:45 +02:00