happyz
/
llama.cpp
mirror of https://github.com/ggerganov/llama.cpp.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
llama.cpp/examples/batched.swift/README.md

113 B
Raw Permalink Blame History

This is a swift clone of examples/batched.

$ ./llama-batched-swift MODEL_PATH [PROMPT] [PARALLEL]