llama.cpp/gguf-py/gguf
Aleksei Nikiforov 64387f6e95
gguf-py: byteswapping improvements (#12851)
* gguf-py: implement byteswapping for Q4_0

This is needed to byteswap Mistral model.

Also restore original shapes after byteswapping tensors.
It is not needed at the moment, but do it in case
they'd be used in future.

* Rework byteswapping code in gguf-py

Move out details from byteswapping tensor blocks code
2025-08-28 16:56:41 +08:00
..
scripts gguf-py: byteswapping improvements (#12851) 2025-08-28 16:56:41 +08:00
__init__.py convert-*.py: GGUF Naming Convention Refactor and Metadata Override Refactor (#7499) 2024-07-18 20:40:15 +10:00
constants.py mtmd : support Kimi VL model (#15458) 2025-08-26 12:54:19 +02:00
gguf.py gguf-py: Refactor and allow reading/modifying existing GGUF files (#3981) 2023-11-11 08:04:50 +03:00
gguf_reader.py gguf-py : display the invalid gguf type (#13687) 2025-05-21 16:33:54 +02:00
gguf_writer.py llama : add gpt-oss (#15091) 2025-08-05 22:10:36 +03:00
lazy.py gguf-py : support lazy tensor splitting (#12809) 2025-04-08 09:03:07 +02:00
metadata.py ggml : model card yaml tab->2xspace (#14819) 2025-07-22 19:29:43 +03:00
py.typed convert : various script cleanups/fixes + merges and special token handling (#2842) 2023-08-30 11:25:50 +03:00
quants.py gguf-py : add Numpy MXFP4 de/quantization support (#15111) 2025-08-08 17:48:26 -04:00
tensor_mapping.py mtmd : support Kimi VL model (#15458) 2025-08-26 12:54:19 +02:00
utility.py convert : improve Mistral models integration (#14737) 2025-08-11 10:07:49 +02:00
vocab.py model : add text-only support for Kimi-VL (and find special tokens in text_config) (#15051) 2025-08-03 16:56:25 +02:00