llama.cpp/examples/speculative
Georgi Gerganov 360a333145
common : add llama_batch_add() and llama_batch_clear() helpers
2023-10-16 12:41:33 +03:00
..
CMakeLists.txt speculative : PoC for speeding-up inference via speculative sampling (#2926) 2023-09-03 15:12:08 +03:00
speculative.cpp common : add llama_batch_add() and llama_batch_clear() helpers 2023-10-16 12:41:33 +03:00