Xuan Son Nguyen
|
f2dbe9c087
|
rm unused fn
|
2025-12-01 14:20:43 +01:00 |
Georgi Gerganov
|
d182544c99
|
server : minor
|
2025-12-01 13:35:40 +02:00 |
|
Xuan Son Nguyen
|
4a1c05c383
|
fix invalid ptr to shutdown_handler
|
2025-11-30 15:31:05 +01:00 |
|
Xuan Son Nguyen
|
7b28b5e16a
|
fix duplicated arg
|
2025-11-30 14:53:47 +01:00 |
|
Xuan Son Nguyen
|
a82dbbfb30
|
decouple server_models from server_routes
|
2025-11-29 23:00:35 +01:00 |
|
Xuan Son Nguyen
|
7be833dacc
|
add TODO for http client
|
2025-11-28 13:10:44 +01:00 |
|
Xuan Son Nguyen
|
e40f35fb61
|
remove support for extra args
|
2025-11-26 15:43:27 +01:00 |
|
Xuan Son Nguyen
|
e514b86d2b
|
fix merge
|
2025-11-24 14:50:42 +01:00 |
|
Xuan Son Nguyen
|
539cbf003e
|
add stdin_file
|
2025-11-24 14:21:21 +01:00 |
|
Xuan Son Nguyen
|
6ed192b4dd
|
add --models-allow-extra-args for security
|
2025-11-24 12:01:16 +01:00 |
|
Xuan Son Nguyen
|
d65be9170b
|
address review comments
|
2025-11-23 19:31:21 +01:00 |
|
Xuan Son Nguyen
|
5ad594e6d6
|
cleaner
|
2025-11-23 19:02:07 +01:00 |
|
Xuan Son Nguyen
|
74685f4194
|
allow reusing args if auto_load
|
2025-11-23 15:42:33 +01:00 |
|
Xuan Son Nguyen
|
f927e21ffc
|
support extra_args on loading model
|
2025-11-23 15:39:03 +01:00 |
|
Xuan Son Nguyen
|
7ef6312f85
|
add note
|
2025-11-23 15:08:31 +01:00 |
|
Xuan Son Nguyen
|
f25bfaba4d
|
expose args and exit_code in API
|
2025-11-23 14:59:04 +01:00 |
|
Xuan Son Nguyen
|
525e2746df
|
address review comments
|
2025-11-21 23:25:34 +01:00 |
|
Xuan Son Nguyen
|
7241558835
|
better --models-dir
|
2025-11-21 23:06:09 +01:00 |
|
Xuan Son Nguyen
|
62ee883d5a
|
implement LRU
|
2025-11-21 22:22:57 +01:00 |
|
Xuan Son Nguyen
|
032b9ff4a9
|
add --models-dir param
|
2025-11-21 11:11:01 +01:00 |
|
Xuan Son Nguyen
|
a2e912cf35
|
address review comment
|
2025-11-20 21:54:22 +01:00 |
|
Xuan Son Nguyen
|
be25bccdff
|
address review comment
|
2025-11-20 21:37:22 +01:00 |
|
Xuan Son Nguyen
|
6929c9f43d
|
address thread safety issue
|
2025-11-20 18:38:02 +01:00 |
|
Xuan Son Nguyen
|
5369aaa1d6
|
address most problems
|
2025-11-20 18:34:22 +01:00 |
|
Xuan Son Nguyen
|
5805ca7960
|
add is_active()
|
2025-11-20 16:26:31 +01:00 |
|
Xuan Son Nguyen
|
d0ea9e0830
|
also allow terminate loading model
|
2025-11-20 16:20:14 +01:00 |
|
Xuan Son Nguyen
|
6610724f8e
|
fix unsafe pointer
|
2025-11-20 16:13:30 +01:00 |
|
Xuan Son Nguyen
|
b9ebdf616a
|
more stable
|
2025-11-20 15:49:40 +01:00 |
|
Xuan Son Nguyen
|
7c6eb17fad
|
fix windows
|
2025-11-20 13:14:56 +01:00 |
|
Xuan Son Nguyen
|
5423d42a35
|
use subprocess.h, better logging
|
2025-11-20 00:05:29 +01:00 |
|
Xuan Son Nguyen
|
54b3545791
|
fix windows build
|
2025-11-19 22:30:47 +01:00 |
|
Xuan Son Nguyen
|
abc0ca478a
|
does this fix windows?
|
2025-11-19 22:24:00 +01:00 |
|
Xuan Son Nguyen
|
399f536dc7
|
fix compile error
|
2025-11-19 21:33:44 +01:00 |
|
Xuan Son Nguyen
|
fc5901a449
|
server: add model management and proxy
|
2025-11-19 21:23:00 +01:00 |