happyz
/
llama.cpp
mirror of https://github.com/ggerganov/llama.cpp.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

SimpleChatTC: ToolCalling enabled, Sliding window adjust 

Chances are for ai models which dont support tool calling, things
will be such that the tool calls meta data shared will be silently
ignored without much issue.

So enabling tool calling feature by default, so that in case one
is using a ai model with tool calling the feature is readily
available for use.

Revert SlidingWindow ChatHistory in Context from last 10 to last 5
(2 more then origianl, given more context support in todays models)
by default, given that now tool handshakes go through the tools
related side channel in the http handshake and arent morphed into
normal user-assistant channel of the handshake.
This commit is contained in:
hanishkvc 2025-11-03 13:02:56 +05:30
parent 1d1894ad14
commit e6fd0ed05a
2 changed files with 12 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

10
tools/server/public_simplechat/readme.md
View File

@ -589,6 +589,16 @@ SimpleProxy
the whitelist inturn picked from config json
* Helpers to fetch file from local file system or the web, transparently
Chances are for ai models which dont support tool calling, things will be such that the tool calls
meta data shared will be silently ignored without much issue. So enabling tool calling feature by default,
so that in case one is using a ai model with tool calling the feature is readily available for use.
Revert SlidingWindow ChatHistory in Context from last 10 to last 5 (rather 2 more then origianl,
given more context support in todays models) by default, given that now tool handshakes go through
the tools related side channel in the http handshake and arent morphed into normal user-assistant
channel of the handshake.
#### ToDo
Is the tool call promise land trap deep enough, need to think through and explore around this once later.

4
tools/server/public_simplechat/simplechat.js
View File

@ -1304,7 +1304,7 @@ class Me {
this.defaultChatIds = [ "Default", "Other" ];
this.multiChat = new MultiChatUI();
this.tools = {
enabled: false,
enabled: true,
proxyUrl: "http://127.0.0.1:3128",
proxyAuthInsecure: "NeverSecure",
searchUrl: SearchURLS.duckduckgo,
@ -1328,7 +1328,7 @@ class Me {
this.chatProps = {
apiEP: ApiEP.Type.Chat,
stream: true,
iRecentUserMsgCnt: 10,
iRecentUserMsgCnt: 5,
bCompletionFreshChatAlways: true,
bCompletionInsertStandardRolePrefix: false,
bTrimGarbage: true,