happyz
/
llama.cpp
mirror of https://github.com/ggerganov/llama.cpp.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

remove whitespace in ggml-cpu.c

This commit is contained in:
Ragesh Hajela 2025-11-10 12:48:48 +05:30 committed by GitHub
parent 21b530eab3
commit 8972883d17
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
ggml/src/ggml-cpu/ggml-cpu.c
View File

@ -1361,7 +1361,7 @@ UseGgmlGemm2:;
// Also, chunking by thread was measured to have perform better on NUMA systems. See https://github.com/ggml-org/llama.cpp/pull/6915
// In theory, chunking should be just as useful on NUMA and non NUMA systems, but testing disagreed with that.
// If the current chunking plan is inefficient for the available threads, re-chunk it by thread.
// - Original observation: For low-core NUMA machines, re-chunking improves performance
// - Original observation: For low-core NUMA machines, re-chunking improves performance
// when there are too few chunks per thread (see https://github.com/ggml-org/llama.cpp/pull/6915).
// - Our observation on AWS Graviton4 (high-core, high-memory bandwidth) shows that
// disabling this re-chunking for nth >= 128 can actually improve performance.