dedadf2a20
Fixed a bug where debug code was included in the release, resulting i… ( #1 )
...
* Fixed a bug where debug code was included in the release, resulting in an undefined function error.
* Change the path of the QNN library when building in termux environment
* Revert "Change the path of the QNN library when building in termux environment"
This reverts commit c6e26a3679da2608940e2163e090adf75d667400.
* Changed so that GGML_QNN_DEFAULT_LIB_SEARCH_PATH can be set from command line arguments
2024-08-20 10:20:23 +08:00
47f6e02eda
fix: try fix the tensor rank of mul mat
2024-07-31 23:54:07 +08:00
74eb05a13b
feat: add ggml_qnn_op_config for handle different op
2024-07-31 20:22:37 +08:00
9a5f802bb6
refactoring: add convient macro to disable copy and move of class
2024-07-29 22:18:48 +08:00
6da82947df
refactoring: set the default qnn lib search path at CMakeLists.txt by GGML_QNN_DEFAULT_LIB_SEARCH_PATH
2024-07-29 15:53:14 +08:00
1f9d2a7e22
refactoring: improve tensor print
2024-07-28 22:05:51 +08:00
e33b5c9837
refactoring: print the name of unsupport op
2024-07-27 13:49:49 +08:00
8ab1f15fe3
refactoring: remove internal functions, use op table directly
2024-07-27 13:43:07 +08:00
e0c9b34016
feat: check if dims equal for add
...
looks qnn add can only applied to matrix with equal dimensions
2024-07-27 13:38:12 +08:00
5da73f8085
refactoring: move forward and supports_op into ops file
2024-07-27 13:24:57 +08:00
867c91bfaf
feat: add error string for QnnOpPackage_Error_t
2024-07-27 13:24:57 +08:00
ccfec70106
refactoring: remove unused get_rpcmem_from_memhandle func
2024-07-27 13:24:57 +08:00
2c73791d62
refactoring: remove dup code
2024-07-27 10:48:09 +08:00
18aa6654d5
refactoring: opt graph key gen
2024-07-27 10:39:07 +08:00
47735cb589
fix: try fix error in 2nd run by appending dimension into graph key
2024-07-26 23:04:53 +08:00
ee305cc171
refactoring: split qnn rpc buffer into dedicated class
2024-07-26 22:52:23 +08:00
f843e5aaf5
fix: 1.free up rpc memory at destruct
...
2. unbind tesnsor
2024-07-25 23:45:04 +08:00
706793f078
fix: back to qnn tensor v1 to fix the create tensor error
2024-07-22 23:08:38 +08:00
3b47056c97
refactoring: change the tensor binding mode between qnn tensor and ggml tensor
2024-07-22 23:08:38 +08:00
b173c4e061
feat: update tensor name when bind to graph
2024-07-20 17:31:40 +08:00
5f3b1ae3b0
fix: try fix graph cache with append the tensors name
2024-07-20 16:39:06 +08:00
51f95d6980
fix: dimension could be wrong for tensor liked 1x1x8
2024-07-20 16:11:35 +08:00
27299463ae
fix: try fix tensor type error
2024-07-20 15:13:10 +08:00
28a00e5e6c
fix: try fix QNN_GRAPH_ERROR_INVALID_OP_CONFIG
2024-07-20 14:11:58 +08:00
1679dcf47e
fix: check all dimentions in `can offload`
2024-07-20 13:29:01 +08:00
b1b5cc10b1
add function to convert qnn error into string
2024-07-19 22:51:17 +08:00
a607995f95
Reapply "tried fix the add node error 6005"
...
This reverts commit f45fbec8f4
2024-07-19 15:35:55 +08:00
f45fbec8f4
Revert "tried fix the add node error 6005"
...
This reverts commit ce3d09e5f2
2024-07-19 12:59:38 +08:00
ce3d09e5f2
tried fix the add node error 6005
2024-07-19 12:59:21 +08:00
15f5cc450c
bug: fix allocation size overflow at log
2024-07-18 19:44:05 +08:00
d82b3a0bdb
feat: add GGML_UNARY_OP_GELU
2024-07-18 11:15:48 +08:00
ce199b2de7
refactoring: downgrade some log to debug level
2024-07-17 23:49:47 +08:00
c76fc9aa2f
fix warnings
2024-07-17 23:32:13 +08:00
6457a68bd7
disable qnn profiling in release build
2024-07-17 23:24:29 +08:00
2502b57203
fix warnings
2024-07-17 22:10:12 +08:00
bb13795dce
refactoring: remove unused functions and variables
2024-07-17 14:17:35 +08:00
63dc587dff
refactoring: make the buffer alloc and free stay in same class
2024-07-17 14:08:31 +08:00
b1ef302991
refactoring: remove depend of dlsym at utils.hpp
2024-07-17 12:21:33 +08:00
0301b500cd
refactoring: prevent leak the QNN_INTERFACE_VER_TYPE and QNN_SYSTEM_INTERFACE_VER_TYPE outside of qnn.hpp
2024-07-17 00:18:38 +08:00
f32327e2b2
remove multiply declearation of log in unit test
2024-07-15 12:06:12 +08:00
148ceab70c
add log op
2024-07-14 23:00:50 +08:00
100ccd5e7f
add unary op template and more ops
2024-07-13 00:55:34 +08:00
e3aa43adbd
suppress warning
2024-07-12 23:26:11 +08:00
f0894d897a
wip
...
wip
2024-07-12 19:57:34 +08:00
be3aa9631f
use template function directly
2024-07-11 11:18:06 +08:00
8932135fdb
add sqrt and mul ops
2024-07-11 00:08:08 +08:00
7ea28a6fac
add helper function for binary op
2024-07-10 23:39:03 +08:00
b6f29273f0
add function to get graph from cache
2024-07-10 23:08:32 +08:00
80051cfc4d
remove unused variables
2024-07-10 19:57:47 +08:00
b49b501e26
fix sprintf type
2024-07-10 19:48:57 +08:00
みゃん
hongruichen