happyz
/
llama.cpp
mirror of https://github.com/ggerganov/llama.cpp.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

SimpleChatTC: Increase the sliding window context to Last4 QA 

As the tool calling, if enabled, will need access to last few
user query and ai assistant responses (which will also include
in them the tool call requests and the corresponding results),
so that the model can build answers based on its tool call reqs
and got responses, and also given that most of the models these
days have sufficiently large context windows, so the sliding
window context implemented by SimpleChat logic has been increased
by default to include last 4 query and their responses roughlty.
This commit is contained in:
hanishkvc 2025-10-14 01:56:34 +05:30
parent a0f6762fda
commit 1789f5f1e2
1 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
tools/server/public_simplechat/simplechat.js
View File

@ -103,7 +103,7 @@ let gUsageMsg = `
<ul class="ul2">
<li> submit tool response placed into user query textarea</li>
</ul>
<li> Default ContextWindow = [System, Last Query+Resp, Cur Query].</li>
<li> Default ContextWindow = [System, Last4 Query+Resp, Cur Query].</li>
<ul class="ul2">
<li> ChatHistInCtxt, MaxTokens, ModelCtxt window to expand</li>
</ul>
@ -886,7 +886,7 @@ class Me {
this.bCompletionFreshChatAlways = true;
this.bCompletionInsertStandardRolePrefix = false;
this.bTrimGarbage = true;
this.iRecentUserMsgCnt = 2;
this.iRecentUserMsgCnt = 5;
this.sRecentUserMsgCnt = {
"Full": -1,
"Last0": 1,