Commit Graph

73 Commits

Author SHA1 Message Date
Ed Addario 2a6f5d7e60
Refactor variable names 2025-10-29 18:32:47 +00:00
Ed Addario 6ff0a79e54
Minor stats report cosmetic changes 2025-10-29 07:59:40 +00:00
Ed Addario 86fabce58d
Clamp values 2025-10-28 23:10:44 +00:00
Ed Addario ab015065b8
Minor refactoring 2025-10-28 23:10:12 +00:00
Ed Addario 92a42bac3d
Type refactoring 2025-10-28 23:06:29 +00:00
Ed Addario b5068df804
Minor refactoring 2025-10-28 23:03:52 +00:00
Ed Addario 0b0381c94c
Merge Cosine Similarity and L2 Norm computation into single loop 2025-10-28 21:41:31 +00:00
Ed Addario dc4a04b5c5
Adjust size calculation and change fallback value to 0.0f 2025-10-28 21:35:35 +00:00
Ed Addario 683ef8dfb7
Fill zeros for experts with zero counts to preserve shape 2025-10-28 18:35:17 +00:00
Ed Addario 637e674da6
Avoid division by zero on zero-count matrices 2025-10-28 18:33:37 +00:00
Ed Addario c9a0874f35
Clamp CosSim to [-1, 1] to avoid float drift 2025-10-28 18:29:59 +00:00
Ed Addario af3b6aca22
Fix legacy_mode getting overwritten on each tensor bug 2025-10-28 18:27:19 +00:00
Ed Addario 8f1aa7885e
Remove activation_statistics() option 2025-08-31 14:03:19 +01:00
Ed Addario 6371902f98
Add --output-format to usage 2025-08-26 21:53:54 +01:00
Ed Addario 630750fdef
Validate number of elements if in_sum is present 2025-08-17 09:42:18 +01:00
Ed Addario 1f72bc157f
Avoid using if statements with initialiser 2025-08-17 08:35:17 +01:00
Ed Addario f6934b9417
Merge branch 'imatrix' of https://github.com/EAddario/llama.cpp into imatrix 2025-08-17 08:20:18 +01:00
Ed Addario 44ea7ddeac
Change statement order 2025-08-17 08:20:03 +01:00
Ed Addario 2e803234f4
Use { and } around conditionally-executed single line statements 2025-08-17 08:19:02 +01:00
Ed Addario a96013f720
Define one variable per line and refactor names 2025-08-17 08:16:41 +01:00
Ed Addario 12607d3203
Use { and } around single line for statement 2025-08-17 08:10:54 +01:00
Ed Addario d19e6c9afa
Use { and } around the conditionally-executed statement
Co-authored-by: compilade <git@compilade.net>
2025-08-17 08:08:26 +01:00
Ed Addario 97d839c441
Using one line per variable definition
Co-authored-by: compilade <git@compilade.net>
2025-08-17 08:06:15 +01:00
Ed Addario 4a487ea7e4
Use { and } around the conditionally-executed statement
Co-authored-by: compilade <git@compilade.net>
2025-08-17 07:26:16 +01:00
Ed Addario e3149a2168
Use the corresponding size
Co-authored-by: compilade <git@compilade.net>
2025-08-17 07:24:27 +01:00
Ed Addario d4b0d89115
Fix return type bug 2025-08-16 11:00:43 +01:00
Ed Addario 030ec53d7a
Remove unnecessary include 2025-08-16 10:46:09 +01:00
Ed Addario 42bfe3b2a3
Update stats output sort based on imatrix type 2025-08-15 21:12:56 +01:00
Ed Addario dcac206f8e
Add --activation-statistics logic to avoid doubling the imatrix size by default 2025-08-09 14:49:25 +01:00
Ed Addario c5ecdaa1a1
Add Euclidean–Cosine Score (ECS) 2025-08-07 19:04:49 +01:00
Ed Addario 5bb2def02d
Add --activation-statistics parameter 2025-08-07 17:41:21 +01:00
Ed Addario dadd90ef73
Rename report heading 2025-08-07 14:07:48 +01:00
Ed Addario e0d6471340
Reverse conditional logic to match convention 2025-08-07 12:04:52 +01:00
Ed Addario 3e9d53c61e
Refactor variable names 2025-08-07 12:03:24 +01:00
Ed Addario 030ed3c909
Merge branch 'master' into imatrix 2025-08-05 21:58:00 +01:00
Ed Addario 88854c9179
Refactor legacy mode 2025-08-05 14:16:45 +01:00
Ed Addario 4c3fea89d6
Update report layout 2025-08-05 13:32:59 +01:00
Ed Addario 49996a19da
Refactor variable names 2025-08-05 13:32:46 +01:00
Ed Addario aea9b31db5
Make ZD Score two-tailed 2025-08-05 12:57:13 +01:00
Ed Addario 906548a00a
Update aggregated sum of squared activations per layer 2025-08-05 12:06:19 +01:00
Ed Addario b37393423d
Compute aggregated (per layer) l2 norm 2025-08-05 08:54:57 +01:00
Ed Addario 5e40cf4f1c
Do not resize if in_sum is null 2025-08-05 00:18:53 +01:00
compilade 19f68fa5a4
imatrix : warn when GGUF imatrix is saved without .gguf suffix (#15076)
* imatrix : add warning when suffix is not .gguf for GGUF imatrix

* imatrix : only warn about suffix when output format is unspecified
2025-08-04 23:26:52 +02:00
Ed Addario adbff66394
Merge branch 'master' into imatrix 2025-08-04 22:16:10 +01:00
Ed Addario c39c4e2a33
Refactor variable name 2025-08-04 22:15:50 +01:00
compilade d31192b4ee
imatrix : use GGUF by default (#14842)
* imatrix : use GGUF by default

* imatrix : use GGUF regardless of the output filename

The legacy format can only be produced with --output-format dat
2025-08-03 22:00:05 +02:00
compilade 0a2f5496be
imatrix : fix 3d activation handling for hybrid and recurrent models (#14994)
* imatrix : use a single count for dense 3d tensors

* imatrix : fix 3d activations when model tensor is 2d

* imatrix : fix 3d tensor counts
2025-08-03 21:49:13 +02:00
Ed Addario f1c2a4ca3f
Fix printing l2 norm when calc_mode = 1 2025-08-03 17:14:46 +01:00
Ed Addario 90cb1be99d
Minor cosmetic changes 2025-08-03 16:57:27 +01:00
Ed Addario 2117c4e54b
Update aggregated statistic report layout 2025-08-03 16:38:02 +01:00