happyz
/
llama.cpp
mirror of https://github.com/ggerganov/llama.cpp.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
llama.cpp/examples/tokenize
History
Mikko Juola 71a08675c0 Simplify tokenize.cpp; by getting rid of handling positional style arguments. 
It must now be invoked with long --model, --prompt etc. arguments only.
Shortens the code.
 		2024-03-28 10:59:23 -07:00
..
CMakeLists.txt examples : add tokenize (#4039) 2023-11-17 17:36:44 +02:00
tokenize.cpp Simplify tokenize.cpp; by getting rid of handling positional style arguments. 2024-03-28 10:59:23 -07:00