happyz
/
gemma.cpp
mirror of https://github.com/google/gemma.cpp.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
gemma.cpp/util
History
Jan Wassenberg 02ce1e344f Use NestedPools, add NUMA infra 
Improved threading.h, fix thread counts for single package/cluster systems
Temporarily forces to a single socket. Prefill 29.28 tps, decode 6.92.

Also fix benchmarks.cc build, update tensor allocator to Allocator

PiperOrigin-RevId: 687307167
 		2024-10-18 08:11:18 -07:00
..
allocator.cc Use NestedPools, add NUMA infra 2024-10-18 08:11:18 -07:00
allocator.h Use NestedPools, add NUMA infra 2024-10-18 08:11:18 -07:00
app.h Use NestedPools, add NUMA infra 2024-10-18 08:11:18 -07:00
args.h Lint fix - string append, remove stale TODO 2024-07-08 04:11:21 -07:00
basics.h Minor cleanup, Windows+Bazel build fixes 2024-10-10 09:05:06 -07:00
test_util.h Minor cleanup/fixes: 2024-09-09 06:58:09 -07:00
threading.h Use NestedPools, add NUMA infra 2024-10-18 08:11:18 -07:00
threading_test.cc Use NestedPools, add NUMA infra 2024-10-18 08:11:18 -07:00