happyz
/
gemma.cpp
mirror of https://github.com/google/gemma.cpp.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
852 Commits 20 Branches 5 Tags 35 MiB
Commit Graph

5 Commits

Author SHA1 Message Date
Phil Culliton 503aaddd65 Add 8-bit integer quantization (I8Stream) to Gemma.cpp. 
PiperOrigin-RevId: 819787856
 2025-10-15 09:25:20 -07:00
Jan Wassenberg f3bc1c17da 1.03x speedup: fused FFN 
matmul-inl: support CView=StridedView or RowPtrs; rename to C_MC_NC
matmul.cc: Allow 1 more rep for MC/NC to allow half-sized tiles, which helps.
PiperOrigin-RevId: 807291701
 2025-09-15 10:26:37 -07:00
Marie White 0d2e74d74a Add MMOptions as an argument to Matmul. 
PiperOrigin-RevId: 802008198
 2025-09-01 23:46:39 -07:00
Jan Wassenberg cf4d7ceb82 1.16x decode speedup: remove last MatVec in Attention 
Precompute row pointers.
Remove no longer used MHA support; QStride -> qkv_dim.
Remove RowPtr from MatMul interface, use only MatPtrT.
Require opt-in define for NUQ to speed up builds.
Also fix io.cc on Windows.

PiperOrigin-RevId: 766228108
 2025-06-02 09:40:29 -07:00
Jan Wassenberg 627cc04db9 Decouple MatMul from gemma-inl: precompile for all input types 
Call MatMulStatic instead of MatMul.

Also fix build error due to Highway's Lanes not being constexpr.

PiperOrigin-RevId: 763777269
 2025-05-27 07:08:58 -07:00