llama.cpp

Commit Graph

Author	SHA1	Message	Date
hongruichen	ee305cc171	refactoring: split qnn rpc buffer into dedicated class	2024-07-26 22:52:23 +08:00
hongruichen	f843e5aaf5	fix: 1.free up rpc memory at destruct 2. unbind tesnsor	2024-07-25 23:45:04 +08:00
hongruichen	3b47056c97	refactoring: change the tensor binding mode between qnn tensor and ggml tensor	2024-07-22 23:08:38 +08:00
hongruichen	b173c4e061	feat: update tensor name when bind to graph	2024-07-20 17:31:40 +08:00
hongruichen	51f95d6980	fix: dimension could be wrong for tensor liked 1x1x8	2024-07-20 16:11:35 +08:00
hongruichen	27299463ae	fix: try fix tensor type error	2024-07-20 15:13:10 +08:00
hongruichen	0301b500cd	refactoring: prevent leak the QNN_INTERFACE_VER_TYPE and QNN_SYSTEM_INTERFACE_VER_TYPE outside of qnn.hpp	2024-07-17 00:18:38 +08:00
hongruichen	b49b501e26	fix sprintf type	2024-07-10 19:48:57 +08:00
hongruichen	3feb574bf0	merge register_rpc_mem into alloc_rpc_mem	2024-07-10 19:40:02 +08:00
hongruichen	e97d3a6c48	fix tensor buffer allocation add log commit qnn buffer after changed add log register_rpc_mem 2 times update input tensors before graph finalize default to QNN_TENSORMEMTYPE_RAW set new tensors at execute move write input tensors to exec check if mem registered before actual do register rpc mem once allocated	2024-07-10 19:32:39 +08:00
hongruichen	9add256efe	use helper function instead	2024-07-10 00:31:39 +08:00
hongruichen	a7be0693ba	add log	2024-07-10 00:29:43 +08:00
Hongrui Chen	5f2e3918f6	refactoring ggml_qnn_tensor	2024-07-09 19:58:46 +08:00
hongruichen	4b0f6b0cd6	add helper function to get Qnn_TensorType_t from ggml_tensor	2024-07-05 19:37:58 +08:00
hongruichen	000240cf62	add clang format file and reformating	2024-07-04 23:29:31 +08:00
hongruichen	8b677d1b2f	move qnn backend into sub folder	2024-07-02 19:42:14 +08:00

16 Commits