happyz
/
gemma.cpp
mirror of https://github.com/google/gemma.cpp.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
787 Commits 18 Branches 5 Tags 35 MiB
Commit Graph

5 Commits

Author SHA1 Message Date
Ivo Ristovski List b56b2f05e4 Automated Code Change 
PiperOrigin-RevId: 789876258
 2025-08-01 13:29:50 -07:00
Jan Wassenberg 799c264df3 Pre-tune thread pool before matmul 
Also improve profiler annotations - remove near-zero ones and add more for startup

PiperOrigin-RevId: 789352414
 2025-07-31 08:45:26 -07:00
Daniel Keysers d7b23d532a Restructure internal initialization. 
PiperOrigin-RevId: 769507096
 2025-06-10 01:25:31 -07:00
Jan Wassenberg 9efdcfd45c 1.07x batch decode speedup: more BF16 weights and activations 
BF16 att_sums and ffw_out
Support BF16 B views without decompression
Support arbitrary types in MulByConstAndAdd, AddFrom

Also update profiler annotations in ops-inl.h

PiperOrigin-RevId: 766995010
 2025-06-03 23:30:18 -07:00
Jan Wassenberg c8d92948f4 Move fields, io* and blob* from compression/ into io/ 
PiperOrigin-RevId: 755445712
 2025-05-06 11:17:19 -07:00