llama.cpp

Commit Graph

Author	SHA1	Message	Date
Olivier Chafik	ab5efbb3b6	Prefix all example bins w/ llama-	2024-06-08 13:42:01 +01:00
Pierrick Hymbert	d0d5de42e5	gguf-split: split and merge gguf per batch of tensors (#6135 ) * gguf-split: split and merge gguf files per tensor * gguf-split: build with make toolchain * gguf-split: rename `--split-tensors-size` to `--split-max-tensors`. Set general.split_count KV to all split * split : minor style + fix compile warnings * gguf-split: remove --upload not implemented --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>	2024-03-19 12:05:44 +01:00

Author

SHA1

Message

Date

Olivier Chafik

ab5efbb3b6

Prefix all example bins w/ llama-

2024-06-08 13:42:01 +01:00

Pierrick Hymbert

d0d5de42e5

gguf-split: split and merge gguf per batch of tensors (#6135 )

* gguf-split: split and merge gguf files per tensor

* gguf-split: build with make toolchain

* gguf-split: rename `--split-tensors-size` to `--split-max-tensors`. Set general.split_count KV to all split

* split : minor style + fix compile warnings

* gguf-split: remove --upload not implemented

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

2024-03-19 12:05:44 +01:00

2 Commits