happyz
/
gemma.cpp
mirror of https://github.com/google/gemma.cpp.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
585 Commits 20 Branches 5 Tags 35 MiB
Commit Graph

5 Commits

Author SHA1 Message Date
Jan Wassenberg 1b72c22345 Refactor Gemma ctor and improve pool NUMA support 
Gemma receives a MatMulEnv arg, with comment on lifetime
Split threading into topology so the latter can be used in allocator
Add AllocClasses() for non-POD (ThreadPool)
Support binding pool to NUMA node
Update threading_test with latency measurements
Also update Highway version.

PiperOrigin-RevId: 736904748
 2025-03-14 10:19:00 -07:00
Jan Wassenberg b0fe9a43e6 Further speed up blob_compare: single alloc, use dual sockets 
PiperOrigin-RevId: 724947361
 2025-02-09 10:53:49 -08:00
Jan Wassenberg f31e12e63b Improved blob diff: parallel, tolerance for float 
PiperOrigin-RevId: 724060325
 2025-02-06 13:46:28 -08:00
Daniel Keysers 7af2e70321 Add python wrappers for configs and inference. 
Enable building compression/python/compression_test using bazel.
Add default image path for image_test and paligemma_test.

PiperOrigin-RevId: 720583438
 2025-01-28 08:22:03 -08:00
Ray Smith 96513a8dc3 Added a blob_compare tool that compares two sbs files that may have the blobs in a different order 
PiperOrigin-RevId: 696458888
 2024-11-14 03:26:32 -08:00