happyz
/
llama.cpp
mirror of https://github.com/ggerganov/llama.cpp.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
llama.cpp/examples/llamacheck
History
Andrew Ferrouolo 7666c4c059 Implemented basic interface for llamacheck and link to weights, adapting from simple.cpp 2024-04-26 22:28:22 -04:00
..
CMakeLists.txt Implemented basic interface for llamacheck and link to weights, adapting from simple.cpp 2024-04-26 22:28:22 -04:00
README.md Implemented basic interface for llamacheck and link to weights, adapting from simple.cpp 2024-04-26 22:28:22 -04:00
llamacheck.cpp Implemented basic interface for llamacheck and link to weights, adapting from simple.cpp 2024-04-26 22:28:22 -04:00

README.md

Llamacheck: Basic Spellcheck and Grammarcheck using Llama

The attached file provides a basic implementation of LLama to be used for Spell and Grammar checking. We use it as follows:

make llamacheck
./llamacheck <./models/llamacheck.gguf>

The weights are quantized. On my machine, it runs with as speed of 7.21 t/s

Weights are available at: https://huggingface.co/azferruolo/llamacheck