gemma.cpp/io
Charles Zhao 50ee1a3e92 Write SBS progressively.
(1) Directly write to file in BlobWriter::Add and destruct the MatOwner to release the rams.

(2) Write a fake header to indicate this is V2, and write correct header and directory at the end of the file.

(3) Tested on loading sbs written the old way, and new way, both worked.

PiperOrigin-RevId: 789306837
2025-07-31 06:05:38 -07:00
..
BUILD.bazel Restructure internal initialization. 2025-06-10 01:25:31 -07:00
blob_compare.cc De-singleton ThreadingContext so callers can pass in their own 2025-07-22 02:08:46 -07:00
blob_store.cc Write SBS progressively. 2025-07-31 06:05:38 -07:00
blob_store.h Write SBS progressively. 2025-07-31 06:05:38 -07:00
blob_store_test.cc Write SBS progressively. 2025-07-31 06:05:38 -07:00
fields.cc Move fields, io* and blob* from compression/ into io/ 2025-05-06 11:17:19 -07:00
fields.h Move fields, io* and blob* from compression/ into io/ 2025-05-06 11:17:19 -07:00
fields_test.cc Move fields, io* and blob* from compression/ into io/ 2025-05-06 11:17:19 -07:00
io.cc Add IsAppendOnly flag to file and if true, disable parallel writes 2025-07-30 01:51:37 -07:00
io.h Add IsAppendOnly flag to file and if true, disable parallel writes 2025-07-30 01:51:37 -07:00
io_win.cc Add IsAppendOnly flag to file and if true, disable parallel writes 2025-07-30 01:51:37 -07:00
migrate_weights.cc Move MatMulEnv out of Gemma to enable concurrent calls 2025-06-23 01:20:09 -07:00