Commit Graph

374 Commits

Author SHA1 Message Date
Xuan-Son Nguyen e509411cf1
server: enable jinja by default, update docs (#17524)
* server: enable jinja by default, update docs

* fix tests
2025-11-27 01:02:50 +01:00
Aleksander Grygier 2a5922b1f6 chore: update webui build output 2025-11-26 17:52:40 +01:00
Aleksander Grygier 13e7988459 refactor: Model modality handling 2025-11-26 17:51:25 +01:00
Xuan Son Nguyen 1493ee09ea tmp webui build 2025-11-26 17:43:27 +01:00
Aleksander Grygier d6ee3d133a refactor: Server store 2025-11-26 17:16:41 +01:00
Aleksander Grygier 456828b365 refactor: Chat requests abort handling 2025-11-26 16:48:13 +01:00
Aleksander Grygier 42483f463d refactor: Remove ConversationsService 2025-11-26 16:45:07 +01:00
Xuan Son Nguyen becc602612 Merge branch 'master' into xsn/server_model_management_v1_2 2025-11-26 16:21:57 +01:00
Xuan Son Nguyen e2731c3767 set hf_repo/docker_repo as model alias when posible 2025-11-26 15:57:20 +01:00
Xuan Son Nguyen e40f35fb61 remove support for extra args 2025-11-26 15:43:27 +01:00
Aleksander Grygier ddf98bdf28 refactor: Improve API header management via utility functions 2025-11-26 15:36:09 +01:00
Aleksander Grygier 9431f358b8 chore: update webui build output 2025-11-26 15:07:12 +01:00
Aleksander Grygier 284557cd2f feat: Improve model loading/unloading status updates 2025-11-26 15:06:11 +01:00
Aleksander Grygier d0d7a88d13 chore: update webui build output 2025-11-26 14:14:15 +01:00
Aleksander Grygier 23a91cd257 refactor: Icons 2025-11-26 14:13:17 +01:00
Aleksander Grygier b1cf8bb814 refactor: Improve server properties management 2025-11-26 14:05:42 +01:00
Aleksander Grygier 19e5385bd5 chore: update webui build output 2025-11-26 02:14:33 +01:00
Aleksander Grygier 2a280b6082 feat: Model management and selection features WIP 2025-11-26 02:13:31 +01:00
Aleksander Grygier 81b8e1abb4 chore: update webui build output 2025-11-26 00:44:18 +01:00
Aleksander Grygier 22507fed74 refactor: Icons 2025-11-26 00:43:49 +01:00
Aleksander Grygier 5207527e9d fix: Audio attachments 2025-11-26 00:21:36 +01:00
Aleksander Grygier c680083cce feat: Remove redundant settigns + rearrange 2025-11-26 00:08:04 +01:00
Aleksander Grygier 33356f36e4 fix: Regenerate 2025-11-26 00:03:17 +01:00
Aleksander Grygier 82975a1f2d fix: Add `untrack` inside chat processing info data logic to prevent infinite effect 2025-11-26 00:01:36 +01:00
Aleksander Grygier 013244933b chore: update webui build output 2025-11-25 17:15:48 +01:00
Aleksander Grygier b9a3129d42 feat: Switching models logic for ChatForm or when regenerating messges + modality detection logic 2025-11-25 17:13:10 +01:00
Aleksander Grygier 4c24ead8e0 chore: update webui build output 2025-11-25 15:06:32 +01:00
Aleksander Grygier 501badc9c4 refactor: Multi-model business logic WIP 2025-11-25 15:04:46 +01:00
Aleksander Grygier f9c911d025 refactor: Remove redundant settings 2025-11-25 10:55:08 +01:00
Aleksander Grygier fed6c82eeb refactor: Database, Conversations & Chat services + stores architecture improvements (WIP) 2025-11-25 10:26:09 +01:00
Aleksander Grygier ccd6c27183 refactor: DatabaseStore -> DatabaseService 2025-11-25 08:08:32 +01:00
Pascal b1846f1c8e
webui: add rehype plugin to restore HTML in Markdown table cells (#17477)
* webui: add rehype plugin to restore HTML in Markdown table cells

The remark/rehype pipeline neutralizes inline HTML as literal text
(remarkLiteralHtml) so that XML/HTML snippets in LLM responses display
as-is instead of being rendered. This causes <br> and <ul> markup in
table cells to show as plain text.

This plugin traverses the HAST post-conversion, parses whitelisted HTML
patterns (<br>, <ul><li>) from text nodes, and replaces them with actual
HAST element nodes. For lists, adjacent siblings must be combined first
as the AST fragmentation breaks pattern matching.

Strict validation rejects malformed markup, keeping it as raw text.

* chore: update webui build output
2025-11-25 08:01:02 +01:00
Aleksander Grygier 7db3d87434 fix: Retrieve lost setting after resolving merge conflict 2025-11-24 16:07:15 +01:00
Xuan Son Nguyen e514b86d2b fix merge 2025-11-24 14:50:42 +01:00
Xuan Son Nguyen 399b39f21b Merge branch 'master' into xsn/server_model_management_v1_2 2025-11-24 14:45:57 +01:00
Xuan-Son Nguyen b8372eecd9
server: split server.cpp code into server/common/task/queue (#17362)
* add server-task, server-common

* add server-queue

* rm redundant includes

* move enum stop_type to server-task

* server : headers cleanup

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
2025-11-24 14:41:53 +01:00
Xuan Son Nguyen 539cbf003e add stdin_file 2025-11-24 14:21:21 +01:00
Xuan Son Nguyen 2c6b58f785 nits 2025-11-24 12:20:34 +01:00
Xuan Son Nguyen 6ed192b4dd add --models-allow-extra-args for security 2025-11-24 12:01:16 +01:00
Aleksander Grygier 5ef3f990b9 chore: update webui build output 2025-11-24 02:24:27 +01:00
Aleksander Grygier b2590a7f6c refactor: Cleanup 2025-11-24 02:24:10 +01:00
Aleksander Grygier 13fe8607c5 refactor: Cleanup 2025-11-24 01:42:42 +01:00
Aleksander Grygier 76557cd5d3 Merge remote-tracking branch 'ngxson/xsn/server_model_management_v1_2' into allozaur/server_model_management_v1_2 2025-11-24 00:36:00 +01:00
Aleksander Grygier e808f2b2e6 chore: update webui build output 2025-11-23 23:45:08 +01:00
Aleksander Grygier 16747dee5b refactor: UI badges 2025-11-23 23:44:14 +01:00
Aleksander Grygier 188d3236e4 chore: update webui build output 2025-11-23 23:28:49 +01:00
Aleksander Grygier 39fb1c2b17 refactor: Cleanup 2025-11-23 23:28:28 +01:00
Aleksander Grygier fb5445e9ce chore: update webui build output 2025-11-23 23:25:05 +01:00
Aleksander Grygier e92ce07916 refactor: Copy To Clipboard Icon component 2025-11-23 23:23:38 +01:00
Aleksander Grygier 219fd19eb8 chore: update webui build output 2025-11-23 23:09:09 +01:00
Aleksander Grygier 41764b8fa0 refactor: Formatters 2025-11-23 22:54:14 +01:00
Aleksander Grygier f8ff39c64e refactor: Cleanup 2025-11-23 22:32:31 +01:00
Aleksander Grygier d5a6671b81 refactor: Cleanup 2025-11-23 22:27:25 +01:00
Aleksander Grygier 49c8062db1 chore: update webui build output 2025-11-23 22:25:34 +01:00
Aleksander Grygier ef5f9d07b0 feat: Improve Model Selector responsiveness 2025-11-23 22:23:50 +01:00
Aleksander Grygier 1c214e9a49 refactor: Enum imports 2025-11-23 22:16:22 +01:00
Aleksander Grygier 48dbef1729 chore: update webui build output 2025-11-23 21:58:38 +01:00
Aleksander Grygier b7ba13b6a0 refactor: Attachments data 2025-11-23 21:46:43 +01:00
Aleksander Grygier 1f0cb3ab26 feat: Use `model` property for displaying the `repo/model-name` naming format 2025-11-23 21:19:00 +01:00
Xuan Son Nguyen d65be9170b address review comments 2025-11-23 19:31:21 +01:00
Xuan Son Nguyen 5ad594e6d6 cleaner 2025-11-23 19:02:07 +01:00
Pascal 0c7220db56
webui: minor settings reorganization and add disable autoscroll option (#17452)
* webui: added a dedicated 'Display' settings section that groups visualization options

* webui: added a Display setting to toggle automatic chat scrolling

* chore: update webui build output
2025-11-23 18:42:00 +01:00
Xuan Son Nguyen 2e355c7f8e oai-compat /models endpoint 2025-11-23 17:25:24 +01:00
Xuan Son Nguyen f95f9c5128 typo docs 2025-11-23 16:14:02 +01:00
Xuan Son Nguyen 74685f4194 allow reusing args if auto_load 2025-11-23 15:42:33 +01:00
Xuan Son Nguyen f927e21ffc support extra_args on loading model 2025-11-23 15:39:03 +01:00
Xuan Son Nguyen 7ef6312f85 add note 2025-11-23 15:08:31 +01:00
Xuan Son Nguyen f25bfaba4d expose args and exit_code in API 2025-11-23 14:59:04 +01:00
Aleksander Grygier 6282537a8b Merge remote-tracking branch 'ngxson/xsn/server_model_management_v1_2' into allozaur/server_model_management_v1_2 2025-11-22 23:35:05 +01:00
Aleksander Grygier 036cc939f8 chore: update webui build output 2025-11-22 19:37:43 +01:00
Aleksander Grygier a39ef24c91 feat: Auto-select model from last assistant response 2025-11-22 19:18:32 +01:00
Aleksander Grygier dc913ec424 feat: Chat Form Actions UI logic improvements 2025-11-22 19:06:17 +01:00
Aleksander Grygier db8ed5df9c feat: Model unavailable UI state for model selector 2025-11-22 19:02:50 +01:00
Aleksander Grygier 076eec6d60 feat: Add copy to clipboard to model name in model info dialog 2025-11-22 19:00:05 +01:00
Xuan Son Nguyen 4af1b6cbac Merge remote-tracking branch 'webui/allozaur/server_model_management_v1_2' into xsn/server_model_maagement_v1_2
Co-authored-by: Aleksander <aleksander.grygier@gmail.com>
2025-11-22 18:39:31 +01:00
Xuan Son Nguyen d32bbfec82 ad endpoint docs 2025-11-22 18:01:48 +01:00
Aleksander Grygier c274f132cb refactor: Chat Form Submit component 2025-11-22 01:35:02 +01:00
Xuan Son Nguyen 525e2746df address review comments 2025-11-21 23:25:34 +01:00
Xuan Son Nguyen 7241558835 better --models-dir 2025-11-21 23:06:09 +01:00
Xuan Son Nguyen 7cd929076d remove default model path 2025-11-21 22:33:04 +01:00
Xuan Son Nguyen 62ee883d5a implement LRU 2025-11-21 22:22:57 +01:00
Aleksander Grygier 92585c7173 feat: Attachments UX improvements 2025-11-21 21:23:20 +01:00
Aleksander Grygier 69503aa519 feat: Add auto-mic setting 2025-11-21 21:18:13 +01:00
Aleksander Grygier 6b7c0a5090 chore: update webui build output 2025-11-21 14:27:45 +01:00
Aleksander Grygier 8b1d96755e feat: New Model Selection UX WIP 2025-11-21 14:26:50 +01:00
Xuan Son Nguyen 032b9ff4a9 add --models-dir param 2025-11-21 11:11:01 +01:00
Aleksander Grygier c26c3402fe chore: update webui build output 2025-11-21 11:10:07 +01:00
Aleksander Grygier 049f40dfdf refactor: Use only the message data `model` property for displaying model used info 2025-11-21 11:00:49 +01:00
Aleksander Grygier 45bf2a4983 Merge remote-tracking branch 'ngxson/xsn/server_model_management_v1_2' into allozaur/server_model_management_v1_2 2025-11-21 09:25:17 +01:00
Aleksander Grygier cc88f6a75b chore: update webui build output 2025-11-21 00:08:09 +01:00
Aleksander Grygier 4bf82a10f1 feat: Improved UX for model information, modality interactions etc 2025-11-21 00:05:43 +01:00
Xuan Son Nguyen a2e912cf35 address review comment 2025-11-20 21:54:22 +01:00
Xuan Son Nguyen cd5c699304 add docs (first version) 2025-11-20 21:45:05 +01:00
Xuan Son Nguyen be25bccdff address review comment 2025-11-20 21:37:22 +01:00
Xuan Son Nguyen 6929c9f43d address thread safety issue 2025-11-20 18:38:02 +01:00
Xuan Son Nguyen 5369aaa1d6 address most problems 2025-11-20 18:34:22 +01:00
Aleksander Grygier c35dee3bd7 Merge remote-tracking branch 'ngxson/xsn/server_model_management_v1_2' into allozaur/server_model_management_v1_2 2025-11-20 16:36:45 +01:00
Aleksander Grygier 8a88576849 refactor: Architecture improvements 2025-11-20 16:34:25 +01:00
Xuan Son Nguyen 5805ca7960 add is_active() 2025-11-20 16:26:31 +01:00
Xuan Son Nguyen d0ea9e0830 also allow terminate loading model 2025-11-20 16:20:14 +01:00