happyz
/
llama.cpp
mirror of https://github.com/ggerganov/llama.cpp.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

typo docs

This commit is contained in:
Xuan Son Nguyen 2025-11-23 16:14:02 +01:00
parent 74685f4194
commit f95f9c5128
1 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
tools/server/README.md
View File

@ -1385,14 +1385,14 @@ models_directory
│ └─ mmproj-F16.gguf # file name must start with "mmproj"
│
│ # multi-shard
├─ gemma-3-4b-it-Q8_0
├─ Kimi-K2-Thinking-UD-IQ1_S
│ ├─ Kimi-K2-Thinking-UD-IQ1_S-00001-of-00006.gguf
│ ├─ Kimi-K2-Thinking-UD-IQ1_S-00002-of-00006.gguf
│ ├─ ...
│ └─ Kimi-K2-Thinking-UD-IQ1_S-00006-of-00006.gguf
```
You may also specify default arguments that will be passed to every loaded model instance:
You may also specify default arguments that will be passed to every model instance:
```sh
llama-server -ctx 8192 -n 1024 -np 2