This makes the 1.625 bpw type go faster than q4_0. Still not the fastest. |
||
|---|---|---|
| .. | ||
| cmake | ||
| include | ||
| src | ||
| CMakeLists.txt | ||
| ggml_vk_generate_shaders.py | ||
This makes the 1.625 bpw type go faster than q4_0. Still not the fastest. |
||
|---|---|---|
| .. | ||
| cmake | ||
| include | ||
| src | ||
| CMakeLists.txt | ||
| ggml_vk_generate_shaders.py | ||