https://github.com/ggerganov/llama.cpp/pull/9418 |
||
|---|---|---|
| .. | ||
| CMakeLists.txt | ||
| README.md | ||
| parallel.cpp | ||
README.md
llama.cpp/example/parallel
Simplified simulation of serving incoming requests in parallel