llama.cpp/examples/speculative
Georgi Gerganov 4de5a2d473
speculative : add tree-based sampling support
ggml-ci
2023-10-14 17:54:02 +03:00
..
CMakeLists.txt speculative : PoC for speeding-up inference via speculative sampling (#2926) 2023-09-03 15:12:08 +03:00
speculative.cpp speculative : add tree-based sampling support 2023-10-14 17:54:02 +03:00