happyz
/
llama.cpp
mirror of https://github.com/ggerganov/llama.cpp.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

SimpleChatTC: Update readme wrt --jinja argument and bit more

This commit is contained in:
hanishkvc 2025-10-13 03:32:58 +05:30
parent a8c8176d09
commit 45d8a00738
1 changed files with 11 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

12
tools/server/public_simplechat/readme.md
View File

@ -7,7 +7,7 @@ by Humans for All.
To run from the build dir
bin/llama-server -m path/model.gguf --path ../tools/server/public_simplechat
bin/llama-server -m path/model.gguf --path ../tools/server/public_simplechat --jinja
Continue reading for the details.
@ -68,6 +68,16 @@ next run this web front end in tools/server/public_simplechat
* cd ../tools/server/public_simplechat
* python3 -m http.server PORT
### for tool calling
remember to
* pass --jinja to llama-server to enable tool calling support from the server ai engine end.
* enable bTools in the settings page of the client side gui.
* use a GenAi/LLM model which supports tool calling.
### using the front end
Open this simple web front end from your local browser