Commit Graph

4 Commits

Author SHA1 Message Date
Georgi Gerganov 652c849643
ggml : add is_ram_shared to ggml_backend
Metal can share the RAM memory and can utilize mmap without temp buffer
2023-07-18 18:51:02 +03:00
slaren 9c72e7e916 rebase to master (except ggml-cuda) 2023-07-16 15:10:46 +02:00
slaren 24cc6f008f minor fixes 2023-07-16 14:56:52 +02:00
slaren 0d2b66c638 ggml backend interface wip
refactor ggml-cuda
2023-07-16 14:56:46 +02:00