happyz
/
gemma.cpp
mirror of https://github.com/google/gemma.cpp.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
gemma.cpp/ops
History
Jan Wassenberg 35fdf848c7 Cascaded summation for Softmax 
This can affect generation results after a few hundred tokens.

Also remove profiler from DecompressAndCall, use Add instead of +=,
use PackedSpan for args and remove alignment requirement.
Changing accumulation order in AssimilateCascadedSums updates dot_test thresholds.

PiperOrigin-RevId: 676891797
 		2024-09-20 10:31:23 -07:00
..
dot-inl.h Cascaded summation for Softmax 2024-09-20 10:31:23 -07:00
dot_test.cc Cascaded summation for Softmax 2024-09-20 10:31:23 -07:00
fp_arith-inl.h Cascaded summation for Softmax 2024-09-20 10:31:23 -07:00
gemma_matvec_test.cc Major compression update, arbitrary-len unpack + new Dot 2024-09-10 02:22:19 -07:00
matmul-inl.h Major compression update, arbitrary-len unpack + new Dot 2024-09-10 02:22:19 -07:00
matmul.h Major MatMul update, 1.9-2.3x speedup on Zen4 via bf16 mul 2024-08-16 07:52:20 -07:00
matmul_test.cc Major compression update, arbitrary-len unpack + new Dot 2024-09-10 02:22:19 -07:00
matvec-inl.h Major compression update, arbitrary-len unpack + new Dot 2024-09-10 02:22:19 -07:00
ops-inl.h Cascaded summation for Softmax 2024-09-20 10:31:23 -07:00
ops_test.cc Add tests for SampleTopK that highlight existing problems and fix those: 2024-09-18 10:32:01 -07:00