happyz
/
llama.cpp
mirror of https://github.com/ggerganov/llama.cpp.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
7,108 Commits 547 Branches 5,764 Tags 1.4 GiB
Commit Graph

234 Commits

Author SHA1 Message Date
Imad Saddik 642a4d68b8 chore: update webui build output 2025-12-20 15:44:02 +01:00
Imad Saddik 9b87eaf898 Updated the disabled text 2025-12-20 15:42:21 +01:00
Imad Saddik fac6ef71a8 chore: update webui build output 2025-12-20 15:27:35 +01:00
Imad Saddik 37be01ac4c Applied formatting 2025-12-20 15:26:23 +01:00
Imad Saddik 689b7a5bd6 Removed console log and refactored the code 2025-12-20 15:25:41 +01:00
Imad Saddik 6db71973ab Applied formatting 2025-12-20 15:18:41 +01:00
Imad Saddik b519235e0a Added the ability to set custom pixel values in the combobox 2025-12-20 15:17:52 +01:00
Imad Saddik 3be006dcaf Display the custom chat width combobox in the settings with just presets 2025-12-20 14:29:15 +01:00
Imad Saddik 14929a77b0 Added the command and popover components 2025-12-20 11:10:06 +01:00
Imad Saddik 416bb35130 Used the new getChatWidth function in ChatProcessingInfo 2025-12-20 09:28:55 +01:00
Imad Saddik 62614a5faa Used the new getChatWidth function in all chat messages components that need it 2025-12-20 09:27:49 +01:00
Imad Saddik dccfcc02eb Used the new getChatWidth function in ChatForm 2025-12-20 09:09:45 +01:00
Imad Saddik 33d8d0f461 Performed formatting 2025-12-20 09:07:54 +01:00
Imad Saddik 61d99bbd88 Used the new chat width logic in ChatScreen and ChatWarning 2025-12-20 09:07:04 +01:00
Imad Saddik b6dbbcc1fb Moved and renamed the width-classes.ts file 2025-12-20 09:04:13 +01:00
Imad Saddik d784cf9bea Renamed the settings keys and added a new field in the settings 2025-12-20 08:51:27 +01:00
Imad Saddik fe680a932b Added support for custom width presets and renamed the constants 2025-12-20 08:49:46 +01:00
Imad Saddik 1cccfaea0f Added new records to SETTING_CONFIG_DEFAULT 2025-12-20 08:25:01 +01:00
Imad Saddik 67c7ed70b2 chore: update webui build output 2025-12-15 22:03:38 +01:00
Imad Saddik c638bfeb21 Updated the MAX_WIDTH_CLASSES constant 2025-12-15 22:02:42 +01:00
Imad Saddik 20f5f32d4d Added custom breakpoints 2025-12-15 22:01:15 +01:00
Imad Saddik cb2926b904 Fixed indentation 2025-12-14 22:01:12 +01:00
Imad Saddik ce0a7e3acc Added new width constants to implement the responsive chat width feature 2025-12-14 21:59:19 +01:00
Imad Saddik dc0ba44991 Fixed the indentation 2025-12-14 21:11:04 +01:00
Imad Saddik 232eba99b4 Added a new setting to control the width of elements based on the screen size 2025-12-14 20:53:08 +01:00
Georgi Gerganov 5b2093becc
server : handle context overflow during decode (#17267) 
* server : handle context overflow during decode

* server : minor refactor
 2025-11-16 09:23:37 +02:00
Aleksander Grygier 22e1ce2f81
webui: Fix clickability around chat processing statistics UI (#17278) 
* fix: Better pointer events handling in chat processing info elements

* chore: update webui build output
 2025-11-15 22:41:41 +01:00
Pascal 1411d9275a
webui: add OAI-Compat Harmony tool-call streaming visualization and persistence in chat UI (#16618) 
* webui: add OAI-Compat Harmony tool-call live streaming visualization and persistence in chat UI

- Purely visual and diagnostic change, no effect on model context, prompt
  construction, or inference behavior

- Captured assistant tool call payloads during streaming and non-streaming
  completions, and persisted them in chat state and storage for downstream use

- Exposed parsed tool call labels beneath the assistant's model info line
  with graceful fallback when parsing fails

- Added tool call badges beneath assistant responses that expose JSON tooltips
  and copy their payloads when clicked, matching the existing model badge styling

- Added a user-facing setting to toggle tool call visibility to the Developer
  settings section directly under the model selector option

* webui: remove scroll listener causing unnecessary layout updates (model selector)

* Update tools/server/webui/src/lib/components/app/chat/ChatMessages/ChatMessageAssistant.svelte

Co-authored-by: Aleksander Grygier <aleksander.grygier@gmail.com>

* Update tools/server/webui/src/lib/components/app/chat/ChatMessages/ChatMessageAssistant.svelte

Co-authored-by: Aleksander Grygier <aleksander.grygier@gmail.com>

* chore: npm run format & update webui build output

* chore: update webui build output

---------

Co-authored-by: Aleksander Grygier <aleksander.grygier@gmail.com>
 2025-11-15 21:09:32 +01:00
Xuan-Son Nguyen 9b17d74ab7
mtmd: add mtmd_log_set (#17268) 2025-11-14 15:56:19 +01:00
Georgi Gerganov d396b43748
server : fix "can batch with" bug (#17263) 2025-11-14 14:03:45 +02:00
Aleksander Grygier f1bad23f88
Better UX for handling multiple attachments in WebUI (#17246) 2025-11-14 01:19:08 +01:00
Xuan-Son Nguyen c4abcb2457
server: fixing naming conflict res_error (#17243) 2025-11-13 20:53:47 +01:00
Aleksander Grygier 8e878f0cb4
Update packages + upgrade Storybook to v10 (#17201) 
* chore: Update packages + upgrade Storybook to v10

* fix: Increase timeout for UI tests
 2025-11-12 19:01:48 +01:00
Xuan-Son Nguyen 00c94083b3
server: (refactor) implement generator-based API for task results (#17174) 
* server: (refactor) implement generator-based API for task results

* improve

* moving some code

* fix "Response ended prematurely"

* add sink.done before return false

* rm redundant check

* rm unused var

* rename generator --> reader
 2025-11-12 18:50:52 +01:00
Xuan-Son Nguyen ee8dd5c658
server: move res_error/res_ok to static function (#17167) 2025-11-12 14:17:24 +01:00
Adrien Gallouët 78010a0d52
cmake : move OpenSSL linking to vendor/cpp-httplib (#17177) 
* cmake : move OpenSSL linking to vendor/cpp-httplib

Signed-off-by: Adrien Gallouët <angt@huggingface.co>

* bring back httplib 0.27.0

* add -DLLAMA_HTTPLIB

* update cmake config for visionos

---------

Signed-off-by: Adrien Gallouët <angt@huggingface.co>
Co-authored-by: Xuan Son Nguyen <son@huggingface.co>
 2025-11-12 12:32:50 +01:00
Xuan-Son Nguyen 1d45b4228f
vendor: split httplib to cpp/h files (#17150) 
* vendor: split httplib to cpp/h files

* move defines

* include httplib if curl is not used

* add TODO

* fix build ios

* fix build visionos instead
 2025-11-11 13:32:58 +01:00
Georgi Gerganov cb1adf8851
server : handle failures to restore host cache (#17078) 
* server : handle failures to restore host cache

* server : add tests for the prompt cache
 2025-11-09 14:27:05 +02:00
chansikpark 333f2595a3
webui: fix keyboard shortcuts for new chat & edit chat title (#17007) 2025-11-08 20:52:35 +01:00
Aidan eeee367de5
server: fix correct time_ms calculation in prompt_progress (#17093) 
* fix: correct time_ms calculation in send_partial_response

The time_ms field was incorrectly calculated. The division was happening
before the subtraction leading to incorrect values.

Before: (ggml_time_us() - slot.t_start_process_prompt / 1000) After:
(ggml_time_us() - slot.t_start_process_prompt) / 1000

* docs : document time_ms field in prompt_progress
 2025-11-08 15:12:11 +02:00
Georgi Gerganov 16bcc1259d
kv-cache : pad the cache size to 256 for performance (#17046) 
* kv-cache : pad the size of the small SWA cache for performance

* context : pad the total context to 256

* cont : future-proof the swa pad

* server : adjust test params to new logic
 2025-11-07 20:03:25 +02:00
Georgi Gerganov 8c0d6bb455
server : print the samplers chain for each request (#17070) 2025-11-07 12:24:47 +02:00
Georgi Gerganov b7f9010d24
server : disable checkpoints with mtmd (#17045) 2025-11-06 12:09:29 +02:00
Georgi Gerganov 13b339bcd9
server : do not default to multiple slots with speculative decoding (#17017) 
* server : do not default to multiple slots with speculative decoding

* cont : fix
 2025-11-05 14:32:55 +02:00
손희준 fd2f84f468
docs: Clarify the endpoint that webui uses (#17001) 2025-11-05 11:20:28 +01:00
Georgi Gerganov 66d8eccd42
server : do context shift only while generating (#17000) 2025-11-04 19:21:36 +02:00
Aleksander Grygier e7da30b584
fix: Viewing multiple PDF attachments (#16974) 2025-11-03 18:53:26 +01:00
Georgi Gerganov 48bd26501b
server : add props.model_alias (#16943) 
* server : add props.model_alias

* webui : npm run format
 2025-11-03 14:38:23 +01:00
Xuan-Son Nguyen 070ff4d535
mtmd: add --image-min/max-tokens (#16921) 2025-11-03 11:11:18 +01:00
Sascha Rogmann bcfa87622a
feat(webui): improve LaTeX rendering with currency detection (#16508) 
* webui : Revised LaTeX formula recognition

* webui : Further examples containg amounts

* webui : vitest for maskInlineLaTeX

* webui: Moved preprocessLaTeX to lib/utils

* webui: LaTeX in table-cells

* chore: update webui build output (use theirs)

* webui: backslash in LaTeX-preprocessing

* chore: update webui build output

* webui: look-behind backslash-check

* chore: update webui build output

* Apply suggestions from code review

Code maintenance (variable names, code formatting, string handling)

Co-authored-by: Aleksander Grygier <aleksander.grygier@gmail.com>

* webui: Moved constants to lib/constants.

* webui: package woff2 inside base64 data

* webui: LaTeX-line-break in display formula

* chore: update webui build output

* webui: Bugfix (font embedding)

* webui: Bugfix (font embedding)

* webui: vite embeds assets

* webui: don't suppress 404 (fonts)

* refactor: KaTeX integration with SCSS

Moves KaTeX styling to SCSS for better customization and font embedding.

This change includes:
- Adding `sass` as a dev dependency.
- Introducing a custom SCSS file to override KaTeX variables and disable TTF/WOFF fonts, relying solely on WOFF2 for embedding.
- Adjusting the Vite configuration to resolve `katex-fonts` alias and inject SCSS variables.

* fix: LaTeX processing within blockquotes

* webui: update webui build output

---------

Co-authored-by: Aleksander Grygier <aleksander.grygier@gmail.com>
 2025-11-03 00:41:08 +01:00