happyz
/
gemma.cpp
mirror of https://github.com/google/gemma.cpp.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
664 Commits 18 Branches 5 Tags 35 MiB
Commit Graph

4 Commits

Author SHA1 Message Date
Jan Wassenberg cf4d7ceb82 1.16x decode speedup: remove last MatVec in Attention 
Precompute row pointers.
Remove no longer used MHA support; QStride -> qkv_dim.
Remove RowPtr from MatMul interface, use only MatPtrT.
Require opt-in define for NUQ to speed up builds.
Also fix io.cc on Windows.

PiperOrigin-RevId: 766228108
 2025-06-02 09:40:29 -07:00
Jan Wassenberg c443adee33 3.8x speedup of weights loading via preadv on Linux 
Also move BlobReader reading functionality to weights.cc

PiperOrigin-RevId: 759240310
 2025-05-15 11:55:15 -07:00
Jan Wassenberg d538a6d6c6 Cleanup: remove unused kCyclic, remove 2 suffix 
Also remove now unused allocator arg and fix warnings (cast, struct/class mismatch)

PiperOrigin-RevId: 758098495
 2025-05-13 01:06:41 -07:00
Jan Wassenberg c8d92948f4 Move fields, io* and blob* from compression/ into io/ 
PiperOrigin-RevId: 755445712
 2025-05-06 11:17:19 -07:00
Renamed from compression/io.cc (Browse further)