happyz
/
gemma.cpp
mirror of https://github.com/google/gemma.cpp.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
407 Commits 20 Branches 5 Tags 35 MiB
Commit Graph

2 Commits

Author SHA1 Message Date
Jan Wassenberg 282f73ec2f Add pin flag to disable pinning. Refs #338 
PiperOrigin-RevId: 661389171
 2024-08-09 13:47:12 -07:00
Jan Wassenberg 5e433e774a 1.1x prefill speedup, revamp threading in preparation for hierarchical parallelism. 
Limit thread counts to detected. Add max_clusters arg.
Update detection logic to check for smt0 - previously we pinned to some siblings.

PiperOrigin-RevId: 659755311
 2024-08-05 18:50:09 -07:00