5 Commits

Author	SHA1	Message	Date
Jan Wassenberg	2e722f14f1	Add mmap support (not yet used) ... Also: const-correct ArgsBase, add assert to mat.h checking element_bytes_ BUILD deps update (:shared provides shared.h, not :sfp) PiperOrigin-RevId: 746073312	2025-04-10 10:03:40 -07:00
Jan Wassenberg	8532da47f7	Major refactor of allocator/args: ... use new ThreadingContext2 instead of monostate/init in each frontend Add ThreadingArgs(replaces AppArgs) backprop: use Packed() accessor and MakePacked factory and row-based access to allow for stride compress_weights: remove, moving to py-only exporter instead Move MatPtr to mat.h and revise interface: - Generic MatOwner - rename accessors to Packed* - support stride/row accessors, fix RowPtr stride Add TypeBits(Type) Move GenerateMat to test_util-inl for sharing between matmul test/bench Move internal init to gemma.cc to avoid duplication Rename GemmaEnv model_ to gemma_ for disambiguating vs upcoming ModelStorage Remove --compressed_weights, use --weights instead. tensor_index: add ExtentsFromInfo and TensorIndexLLM/Img Allocator: use normal unique_ptr for AllocBytes so users can call directly threading: use -> because AlignedPtr no longer assumes arrays PiperOrigin-RevId: 745918637	2025-04-10 01:29:54 -07:00
Daniel Keysers	f173aa776e	Add conversion tool for HF safetensors to gemma.cpp for PaliGemma. ... PiperOrigin-RevId: 725990158	2025-02-12 03:47:43 -08:00
Oleh Prypin	82ca526c0c	Remove `srcs_version` and `python_version` attributes, as they already default to `"PY3"` ... PiperOrigin-RevId: 724122259	2025-02-06 16:51:11 -08:00
Daniel Keysers	7af2e70321	Add python wrappers for configs and inference. ... Enable building compression/python/compression_test using bazel. Add default image path for image_test and paligemma_test. PiperOrigin-RevId: 720583438	2025-01-28 08:22:03 -08:00