This commit introduces a sampling_info struct to encapsulate all backend sampling related data within the llama_context class. It also updates to use more descriptive names for sampled tokens and candidates in the backend sampler ggml data structure. |
||
|---|---|---|
| .. | ||
| llama-cpp.h | ||
| llama.h | ||