happyz
/
gemma.cpp
mirror of https://github.com/google/gemma.cpp.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
gemma.cpp/compression
History
Jan Wassenberg 2308514e5a Experiment with compensated dot product. 
ULP difference vs exact is 0..1, vs 200-5000 for previous.
Runtime overhead is 2.5-4x for f32 input.

PiperOrigin-RevId: 668084019
 		2024-08-27 12:05:35 -07:00
..
python Add Python code for converting Griffin Orbax weights. Refs #301 2024-07-29 12:53:30 -07:00
BUILD Experiment with compensated dot product. 2024-08-27 12:05:35 -07:00
analyze.h Remove no longer required stats.h - use Highway version instead 2024-06-05 01:37:48 -07:00
blob_store.cc Make BlobWriter::Add() accept const void* 2024-05-17 08:11:06 -07:00
blob_store.h Make BlobWriter::Add() accept const void* 2024-05-17 08:11:06 -07:00
compress-inl.h Experiment with compensated dot product. 2024-08-27 12:05:35 -07:00
compress.h 0.98x prefill: refactor in prep for cache blocking. 2024-08-12 09:26:29 -07:00
compress_weights.cc Refactor configurables. 2024-07-10 21:30:58 -07:00
convert_weights.py Cleanup: move util/compress and convert_weights to compression/ 2024-07-05 04:16:52 -07:00
distortion.h Experiment with compensated dot product. 2024-08-27 12:05:35 -07:00
distortion_test.cc Update distortion.h to weighted average, add distortion_test. 2024-04-17 01:44:19 -07:00
io.cc Further improve IO, enable multiple backends without -D. 2024-04-19 00:40:29 -07:00
io.h Major duplicated code reduction in test/benchmarks 2024-06-14 00:16:25 -07:00
io_win.cc Further improve IO, enable multiple backends without -D. 2024-04-19 00:40:29 -07:00
nuq-inl.h revert back to HWY_ASSERT for lane constraints, qualify hn::Add 2024-06-04 10:10:18 -07:00
nuq.h initial commit 2024-02-21 03:31:22 +00:00
nuq_test.cc Remove no longer required stats.h - use Highway version instead 2024-06-05 01:37:48 -07:00
sfp-inl.h Experiment with compensated dot product. 2024-08-27 12:05:35 -07:00
sfp.h initial commit 2024-02-21 03:31:22 +00:00
sfp_test.cc Experiment with compensated dot product. 2024-08-27 12:05:35 -07:00
test_util.h Remove no longer required stats.h - use Highway version instead 2024-06-05 01:37:48 -07:00
weights_raw.h Major MatMul update, 1.9-2.3x speedup on Zen4 via bf16 mul 2024-08-16 07:52:20 -07:00