happyz
/
gemma.cpp
mirror of https://github.com/google/gemma.cpp.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
gemma.cpp/examples
History
Jan Wassenberg 8d0882b966 Huge refactor of weight handling and model loading. 
Weight handling:
- new ModelStore2 supports both pre-2025 multi-file and single-file formats
- simpler ForEachTensor with TensorArgs
- tensors are constructed with their full suffixed name

I/O:
- support mmap and stride
- Simplified SbsWriter, single insert(); add SbsReader

Misc:
- kMockTokenizer: allow creating with unavailable tokenizer
- configs.h: Simpler enum validity checks via kSentinel
- matmul.h: remove unused enable_bind (now in allocator.h)
- tensor_info: single TensorInfoRegistry class, rename from tensor_index.h

Frontends:
- Replace Allocate/CreateGemma with ctor(LoaderArgs, MatMulEnv&)
- Deduce model/weight type, remove --model and parsing
- Replace most common.h includes with configs.h
- Remove --compressed_weights, use --weights instead
- Remove ModelInfo, replaced by ModelConfig.

Backprop:
- Reduce max loss, remove backward_scalar_test (timeout)
- Update thresholds because new RandInit changes rng eval order and thus numerics
PiperOrigin-RevId: 755317484
 		2025-05-06 04:44:21 -07:00
..
hello_world Huge refactor of weight handling and model loading. 2025-05-06 04:44:21 -07:00
simplified_gemma Huge refactor of weight handling and model loading. 2025-05-06 04:44:21 -07:00
README.md Update README with more details on contributing code, add experimental/ directory, add READMEs for subdirectories, clean up DEVELOPER notes 2024-03-15 14:10:24 -04:00

README.md

Examples

In this directory are some simple examples illustrating usage of gemma.cpp as a library beyond the interactive gemma app implemented in run.cc.

  • hello_world/ - minimal/template project for using gemma.cpp as a library. It sets up the model state and generates text for a single hard coded prompt.