happyz
/
llama.cpp
mirror of https://github.com/ggerganov/llama.cpp.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

SimpleChatTCRV: Update readme a bit, need to cleanup later

This commit is contained in:
hanishkvc 2025-11-14 16:17:58 +05:30
parent e731d29dc9
commit 67b9c68b3e
1 changed files with 14 additions and 5 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

19
tools/server/public_simplechat/readme.md
View File

@ -114,8 +114,8 @@ remember to
### for vision models
* remember to specify a mmproj file directly or by using -hf to fetch the model and its mmproj gguf
from huggingface.
* remember to specify the multimodal related gguf file directly using -mmproj or by using -hf to fetch
the llm model and its mmproj gguf from huggingface.
* additionally specify a large enough -batch-size (ex 8k) and -ubatch-size (ex 2k)
@ -184,13 +184,20 @@ Once inside
* the SimpleChat client will show details of the tool call (ie tool name and args passed) requested
and allow the user to trigger it as is or after modifying things as needed.
NOTE: Tool sees the original tool call only, for now
* inturn returned / generated result is placed into user query entry text area with approriate tags
ie <tool_response> generated result with meta data </tool_response>
* inturn returned / generated result is placed into user query entry text area,
and the color of the user query text area is changed to indicate the same.
* if user is ok with the tool response, they can click submit to send the same to the GenAi/LLM.
User can even modify the response generated by the tool, if required, before submitting.
* ALERT: Sometimes the reasoning or chat from ai model may indicate tool call, but you may actually
not get/see a tool call, in such situations, dont forget to cross check that tool calling is
enabled in the settings.
enabled in the settings. Also click on the current chat session's button at the top, to refresh
the ui, just in case.
* when the user is going through the chat messages in the chat session, they can
* delete any message from the chat session,
* remember that you need to maintain the expected sequence of chat message roles
ie user - assistant - {tool response} - user - assistant - kind of sequence.
* copy text content of messages to clipboard.
* ClearChat/Refresh
* use the clearchat button to clear the currently active chat session.
@ -746,10 +753,12 @@ sliding window based drop off or even before they kick in, this can help in many
* ChatMessage
* assign a globally unique (ie across sessions) id to each chat message instance.
* add support for deleting chat message based on its uniquie id in SimpleChat.
* try ensure that adjacent messages remain on screen, after a message is deleted from session.
* add a popover div block in html, which acts as a popup menu containing buttons to work with
individual chat messages.
* experiment and finalise on anchor based relative positioning of the popover menu.
* have a del button, which allows one to delete the currently in focus chat message.
* have a copy button, which allows one to copy the textual content into system clipboard.
#### ToDo