mirror of https://github.com/google/gemma.cpp.git
8c0a8834c1
Compression:
* Implement {any packed} x {bf16, f32} 'Load2' and DecompressAndZeroPad
* New compression test for all packed formats, add to GEMMA_TEST_FILES, remove from sfp/nuq_test
* Decompress->DecompressAndZeroPad, use PackedSpan for args with bounds checking
* NUQ: support arbitrary-length enc/dec
* New compression/shared, remove sfp.h and nuq.h
* Move Store2 into Traits and provide Compress2 wrapper
* Remove unused Decompress()-with-pool overload
* Simplify CompressedArrayLen, rename to CompressedArrayElements
* Remove unused DistortionStats b_l1_
Misc:
* Add compensated and Kahan dot, support any length
* Use same Dot function everywhere
* Move exact arithmetic functions into fp_arith
* use FloatPtr and MatPtr typedefs in tests; less stack usage
* Rename args to packed/raw
* Remove Traits::Name, instead TypeName<T>()
* Move kMaxSFP and kClusters/kGroupSize into Sfp/NuqStream
PiperOrigin-RevId: 672868468
|
||
|---|---|---|
| .. | ||
| evals | ||
| instantiations | ||
| activations.h | ||
| common.cc | ||
| common.h | ||
| configs.h | ||
| gemma-inl.h | ||
| gemma.cc | ||
| gemma.h | ||
| kv_cache.cc | ||
| kv_cache.h | ||
| run.cc | ||
| tokenizer.cc | ||
| tokenizer.h | ||
| weights.cc | ||
| weights.h | ||