5 Commits

Author	SHA1	Message	Date
Ray Smith	9d40f0117e	Added ability to load/save a complete model file, including tokenizer. ... PiperOrigin-RevId: 707914366	2024-12-19 07:59:41 -08:00
Ray Smith	e69bc3bc1c	Added the TensorInfo arg to the compressor so the shape and scale can be output correctly to the file in future. ... Corrected some errors in the TensorIndex. PiperOrigin-RevId: 705014619	2024-12-11 01:26:35 -08:00
Jan Wassenberg	642fc97d51	Internal change ... PiperOrigin-RevId: 704692923	2024-12-10 06:58:32 -08:00
Ray Smith	3d1625d8c5	Improved consistency of compressor API, and added a universal method with a target type arg. ... Moved configs pybind up to root level. PiperOrigin-RevId: 698743417	2024-11-21 05:27:40 -08:00
Paul Chang	5674c33dc5	Replace CLIF SbsWriter with pybind-based gcpp extension ... Maintains compatibility with previous version. PiperOrigin-RevId: 696181603	2024-11-13 10:20:02 -08:00