7 Commits

Author	SHA1	Message	Date
Georgi Gerganov	583cb83416	ggml : add ggml_top_k (#17365) ... * ggml : add ggml_top_k * cont : add ggml_argsort_top_k * metal : add top_k support * ggml : cleanup * tests : add virtual err() function for test_case * ggml : add comments	2025-11-25 15:31:43 +02:00
Georgi Gerganov	1a139644a8	metal : add cumsum (#17305)	2025-11-17 11:51:13 +02:00
Georgi Gerganov	45c6ef7307	metal : support argsort for ne00 > 1024 (#17247) ... * metal : refactor argsort * cont : sort chunks * cont : merge sorted buckets * cont : cleanup	2025-11-14 09:36:06 +02:00
Georgi Gerganov	b2c08c9ec4	metal : mark FA blocks (#16372) ... * metal : better unroll in the FA kernels * metal : index FA blocks * tests : restore [no ci] * metal : prevent division by zero in FA kernels * metal : fix -INF detection logic	2025-10-08 10:57:53 +03:00
Georgi Gerganov	0a319bb75e	metal : add support for non-padded FA KV (#16148) ... * metal : pad K, V and Mask when needed * cont : simplify * cuda : add TODO about KV padding requirement * metal : add comments * metal : remove mask padding requirement	2025-10-07 08:23:30 +03:00
Jeff Bolz	c0b45097c3	rename optimize_graph to graph_optimize (#16082)	2025-09-18 13:46:17 -05:00
Georgi Gerganov	0320ac5264	metal : refactor + optimize v2 (#15995) ... * metal : improve naming * metal : refactor device ggml-ci * cont : props ggml-ci * metal : apply ggml_mem_ranges_t ggml-ci * metal : remove GGML_METAL_USE_BF16 ggml-ci * metal : refactor device buffer ggml-ci * cont : fix naming * metal : sync before destroying the backend ggml-ci * metal : refactor context ggml-ci * metal : migrate ggml-metal.m to ggml-metal.cpp ggml-ci * metal : adjust ops API ggml-ci * metal : use C++ to store piplienes ggml-ci * metal : migrate ops to separate functions ggml-ci * metal : add ggml_metal_library_t ggml-ci * metal : improve naming ggml-ci * metal : cleanp ggml-ci * metal : add support for GGML_OP_LOG ggml-ci * metal : fix error handling ggml-ci	2025-09-17 20:38:12 +03:00