happyz
/
gemma.cpp
mirror of https://github.com/google/gemma.cpp.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
710 Commits 11 Branches 5 Tags 38 MiB
Commit Graph

5 Commits

Author SHA1 Message Date
The gemma.cpp Authors 6dd1cd277f Automated Code Change 
PiperOrigin-RevId: 781944269
 2025-08-01 13:11:10 -07:00
Jan Wassenberg 799c264df3 Pre-tune thread pool before matmul 
Also improve profiler annotations - remove near-zero ones and add more for startup

PiperOrigin-RevId: 789352414
 2025-07-31 08:45:26 -07:00
Daniel Keysers d7b23d532a Restructure internal initialization. 
PiperOrigin-RevId: 769507096
 2025-06-10 01:25:31 -07:00
Jan Wassenberg 9efdcfd45c 1.07x batch decode speedup: more BF16 weights and activations 
BF16 att_sums and ffw_out
Support BF16 B views without decompression
Support arbitrary types in MulByConstAndAdd, AddFrom

Also update profiler annotations in ops-inl.h

PiperOrigin-RevId: 766995010
 2025-06-03 23:30:18 -07:00
Jan Wassenberg c8d92948f4 Move fields, io* and blob* from compression/ into io/ 
PiperOrigin-RevId: 755445712
 2025-05-06 11:17:19 -07:00