41361c8599
The build info is now only for debug, so we avoid the duplicate with `--version`. The UTF-8 setup at the beginning is needed to avoid logging garbage on Windows. Signed-off-by: Adrien Gallouët <angt@huggingface.co> |
||
|---|---|---|
| .. | ||
| CMakeLists.txt | ||
| README.md | ||
| results.cpp | ||
README.md
Results
The llama-results tool can be used to --check the outputs of a model vs. a previous commit to detect whether they have changed.
Example usage:
llama-results --model model.gguf --output results.gguf --prompt "People die when they are killed." # writes results to file
llama-results --model model.gguf --output results.gguf --prompt "People die when they are killed." --check # compares results vs file
The metric by which the results are compared is the normalized mean squared error (NMSE) with a tolerance of 10^{-6}.