gemma.cpp/util
Jan Wassenberg 1b72c22345 Refactor Gemma ctor and improve pool NUMA support
Gemma receives a MatMulEnv arg, with comment on lifetime
Split threading into topology so the latter can be used in allocator
Add AllocClasses() for non-POD (ThreadPool)
Support binding pool to NUMA node
Update threading_test with latency measurements
Also update Highway version.

PiperOrigin-RevId: 736904748
2025-03-14 10:19:00 -07:00
..
allocator.cc Refactor Gemma ctor and improve pool NUMA support 2025-03-14 10:19:00 -07:00
allocator.h Refactor Gemma ctor and improve pool NUMA support 2025-03-14 10:19:00 -07:00
app.h Refactor Gemma ctor and improve pool NUMA support 2025-03-14 10:19:00 -07:00
args.h Simpler MatMul interface, vocab types, Tristate for use_spinning 2024-11-04 07:48:29 -08:00
basics.h Use vectorized TopK using highway VQSelect 2025-02-18 05:01:39 -08:00
test_util.h Minor cleanup/fixes: 2024-09-09 06:58:09 -07:00
threading.cc Refactor Gemma ctor and improve pool NUMA support 2025-03-14 10:19:00 -07:00
threading.h Refactor Gemma ctor and improve pool NUMA support 2025-03-14 10:19:00 -07:00
threading_test.cc Refactor Gemma ctor and improve pool NUMA support 2025-03-14 10:19:00 -07:00
topology.cc Refactor Gemma ctor and improve pool NUMA support 2025-03-14 10:19:00 -07:00
topology.h Refactor Gemma ctor and improve pool NUMA support 2025-03-14 10:19:00 -07:00