happyz
/
gemma.cpp
mirror of https://github.com/google/gemma.cpp.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
795 Commits 20 Branches 5 Tags 35 MiB
Commit Graph

3 Commits

Author SHA1 Message Date
Jan Wassenberg 627cc04db9 Decouple MatMul from gemma-inl: precompile for all input types 
Call MatMulStatic instead of MatMul.

Also fix build error due to Highway's Lanes not being constexpr.

PiperOrigin-RevId: 763777269
 2025-05-27 07:08:58 -07:00
Jan Wassenberg 35fdf848c7 Cascaded summation for Softmax 
This can affect generation results after a few hundred tokens.

Also remove profiler from DecompressAndCall, use Add instead of +=,
use PackedSpan for args and remove alignment requirement.
Changing accumulation order in AssimilateCascadedSums updates dot_test thresholds.

PiperOrigin-RevId: 676891797
 2024-09-20 10:31:23 -07:00
Jan Wassenberg c29e9752c7 Refactor/cleanup, remove even_odd 
* New compression/shared.h, remove sfp.h
* Remove unused DistortionStats b_l1_
* Move exact arithmetic functions into fp_arith
* Remove even_odd optimization for MatVec (mostly unused)
* use BF16 typedef more widely
* Add kMaxSFP constant

PiperOrigin-RevId: 670996386
 2024-09-04 09:25:13 -07:00