happyz
/
gemma.cpp
mirror of https://github.com/google/gemma.cpp.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
576 Commits 20 Branches 5 Tags 35 MiB
Commit Graph

53 Commits

Author SHA1 Message Date
Jan Wassenberg f27683152c 1.05x prefill speedup: matvec -> matmul for !MHA 
Also add C_stride and make shape normal non-template arguments.

PiperOrigin-RevId: 657285945
 2024-07-29 12:18:06 -07:00
Jan Wassenberg 2721f54446 Add offset arg to MatMul, rename, Matmul for logits = ~1.1x decode speedup 
PiperOrigin-RevId: 657167257
 2024-07-29 05:34:26 -07:00
Jan Wassenberg 85cac13fb1 Split up ops.h into ops/ops-inl and matmul-inl 
PiperOrigin-RevId: 654068303
 2024-07-19 11:21:48 -07:00