gemma.cpp/evals
Jan Wassenberg 8c0a8834c1 Major compression update, arbitrary-len unpack + new Dot
Compression:
* Implement {any packed} x {bf16, f32} 'Load2' and DecompressAndZeroPad
* New compression test for all packed formats, add to GEMMA_TEST_FILES, remove from sfp/nuq_test
* Decompress->DecompressAndZeroPad, use PackedSpan for args with bounds checking
* NUQ: support arbitrary-length enc/dec
* New compression/shared, remove sfp.h and nuq.h
* Move Store2 into Traits and provide Compress2 wrapper
* Remove unused Decompress()-with-pool overload
* Simplify CompressedArrayLen, rename to CompressedArrayElements
* Remove unused DistortionStats b_l1_

Misc:
* Add compensated and Kahan dot, support any length
* Use same Dot function everywhere
* Move exact arithmetic functions into fp_arith
* use FloatPtr and MatPtr typedefs in tests; less stack usage
* Rename args to packed/raw
* Remove Traits::Name, instead TypeName<T>()
* Move kMaxSFP and kClusters/kGroupSize into Sfp/NuqStream
PiperOrigin-RevId: 672868468
2024-09-10 02:22:19 -07:00
..
benchmark.cc Add an additional QueryModel() overload to GemmaEnv. 2024-09-03 02:25:19 -07:00
benchmark_helper.cc Major compression update, arbitrary-len unpack + new Dot 2024-09-10 02:22:19 -07:00
benchmark_helper.h Add an additional QueryModel() overload to GemmaEnv. 2024-09-03 02:25:19 -07:00
benchmarks.cc Move benchmark_helper to evals/, weights_raw to compression/. 2024-07-08 01:13:23 -07:00
cross_entropy.cc Cleanup: add ModelInfo struct, remove gcpp:: 2024-07-02 07:11:15 -07:00
cross_entropy.h Declutter gemma/ directory, move binaries to evals/ and util/. 2024-07-01 09:51:04 -07:00
debug_prompt.cc Extend LayersOutputFunc to take query index and auxillary int 2024-07-30 06:53:56 -07:00
gemma_test.cc Internal change. Slight restructuring of gemma_test. 2024-09-03 06:16:09 -07:00
run_mmlu.cc Add an additional QueryModel() overload to GemmaEnv. 2024-09-03 02:25:19 -07:00