llama.cpp

Commit Graph

Author	SHA1	Message	Date
hongruichen	100ccd5e7f	add unary op template and more ops	2024-07-13 00:55:34 +08:00
hongruichen	e3aa43adbd	suppress warning	2024-07-12 23:26:11 +08:00
hongruichen	f0894d897a	wip wip	2024-07-12 19:57:34 +08:00
hongruichen	be3aa9631f	use template function directly	2024-07-11 11:18:06 +08:00
hongruichen	8932135fdb	add sqrt and mul ops	2024-07-11 00:08:08 +08:00
hongruichen	7ea28a6fac	add helper function for binary op	2024-07-10 23:39:03 +08:00
hongruichen	b6f29273f0	add function to get graph from cache	2024-07-10 23:08:32 +08:00
hongruichen	80051cfc4d	remove unused variables	2024-07-10 19:57:47 +08:00
hongruichen	b49b501e26	fix sprintf type	2024-07-10 19:48:57 +08:00
hongruichen	3feb574bf0	merge register_rpc_mem into alloc_rpc_mem	2024-07-10 19:40:02 +08:00
hongruichen	e97d3a6c48	fix tensor buffer allocation add log commit qnn buffer after changed add log register_rpc_mem 2 times update input tensors before graph finalize default to QNN_TENSORMEMTYPE_RAW set new tensors at execute move write input tensors to exec check if mem registered before actual do register rpc mem once allocated	2024-07-10 19:32:39 +08:00
hongruichen	dc7d83e121	add log	2024-07-10 00:33:23 +08:00
hongruichen	9add256efe	use helper function instead	2024-07-10 00:31:39 +08:00
hongruichen	a7be0693ba	add log	2024-07-10 00:29:43 +08:00
hongruichen	af869fd636	fix compiling error in debug build	2024-07-10 00:23:51 +08:00
Hongrui Chen	5f2e3918f6	refactoring ggml_qnn_tensor	2024-07-09 19:58:46 +08:00
hongruichen	263ffa962e	small opt of the qnn graph config init	2024-07-05 23:07:27 +08:00
hongruichen	4b0f6b0cd6	add helper function to get Qnn_TensorType_t from ggml_tensor	2024-07-05 19:37:58 +08:00
hongruichen	0f2e68713c	move tensor related function to utils	2024-07-05 19:02:38 +08:00
hongruichen	58cec14092	reformat	2024-07-05 17:38:54 +08:00
hongruichen	13dc3a02c3	use qnn graph inside add and mul ops	2024-07-05 13:27:16 +08:00
hongruichen	a688ed324b	add op param to add_nodes	2024-07-05 13:07:48 +08:00
hongruichen	4b2ee61f62	move graph map to backend object	2024-07-05 11:58:47 +08:00
hongruichen	ca0d999c2a	add ggml_qnn_graph	2024-07-05 11:35:18 +08:00
hongruichen	000240cf62	add clang format file and reformating	2024-07-04 23:29:31 +08:00
hongruichen	38f88d5fb1	fix compiling error after merge latest master	2024-07-03 00:13:53 +08:00
hongruichen	8b677d1b2f	move qnn backend into sub folder	2024-07-02 19:42:14 +08:00

27 Commits