llama.cpp/examples/parallel/README.md

4 lines
94 B
Markdown

# llama.cpp/example/parallel
Simplified simluation for serving incoming requests in parallel