mirror of https://github.com/google/gemma.cpp.git
8d0882b966
Weight handling: - new ModelStore2 supports both pre-2025 multi-file and single-file formats - simpler ForEachTensor with TensorArgs - tensors are constructed with their full suffixed name I/O: - support mmap and stride - Simplified SbsWriter, single insert(); add SbsReader Misc: - kMockTokenizer: allow creating with unavailable tokenizer - configs.h: Simpler enum validity checks via kSentinel - matmul.h: remove unused enable_bind (now in allocator.h) - tensor_info: single TensorInfoRegistry class, rename from tensor_index.h Frontends: - Replace Allocate/CreateGemma with ctor(LoaderArgs, MatMulEnv&) - Deduce model/weight type, remove --model and parsing - Replace most common.h includes with configs.h - Remove --compressed_weights, use --weights instead - Remove ModelInfo, replaced by ModelConfig. Backprop: - Reduce max loss, remove backward_scalar_test (timeout) - Update thresholds because new RandInit changes rng eval order and thus numerics PiperOrigin-RevId: 755317484 |
||
|---|---|---|
| .. | ||
| python | ||
| BUILD.bazel | ||
| analyze.h | ||
| blob_compare.cc | ||
| blob_store.cc | ||
| blob_store.h | ||
| blob_store_test.cc | ||
| compress-inl.h | ||
| compress.cc | ||
| compress.h | ||
| compress_test.cc | ||
| distortion.h | ||
| distortion_test.cc | ||
| fields.cc | ||
| fields.h | ||
| fields_test.cc | ||
| io.cc | ||
| io.h | ||
| io_win.cc | ||
| migrate_weights.cc | ||
| nuq-inl.h | ||
| nuq_test.cc | ||
| sfp-inl.h | ||
| sfp_test.cc | ||
| shared.h | ||
| test_util-inl.h | ||