zhanmyz
|
49804f43fc
|
add GET_ROWS operator of OpenVINO to GGML of llama.cpp
|
2026-01-15 10:05:41 -08:00 |
yumengbo
|
9b7b63d12c
|
Convert subgraph with add, sub, mul, div op to ov model and do infer on openvino device
|
2026-01-15 10:05:41 -08:00 |
yumengbo
|
171c4681f4
|
Add PoC of integration of openvino frontend. Main changes: ggml-ov-frontend-utils, GraphIterator, Decoder
|
2026-01-15 10:05:41 -08:00 |
zhanmyz
|
ee31dc1c1b
|
add get openvino available ops function
|
2026-01-15 10:05:41 -08:00 |
zhanmyz
|
77d68146a8
|
add OpenVINO frontend convert process steps
|
2026-01-15 10:05:41 -08:00 |
zhanmyz
|
0a81aa19f7
|
Add compile options
|
2026-01-15 10:05:40 -08:00 |
zhanmyz
|
adc2c70f44
|
Add OpenVINO MUL operator to GGML of Llama.cpp.
|
2026-01-15 10:05:40 -08:00 |
zhanmyz
|
faa4a7de76
|
Solve the issue of abnormal model output caused by using OpenVINO ADD operator
|
2026-01-15 10:05:40 -08:00 |
zhanmyz
|
9b9d51dddf
|
* Configure the device(default CPU) that uses OpenVINO to compile the model
* Add OpenVINO ADD operator to Llama.cpp. The output is somewhat abnormal and needs further debugging.
|
2026-01-15 10:05:40 -08:00 |
zhanmyz
|
5294402b50
|
add openvino as optional backend for Llama.cpp ggml
|
2026-01-15 10:05:40 -08:00 |
Yanglei Zou
|
fe5720e684
|
Add ggml-openvino base files
|
2026-01-15 10:05:40 -08:00 |