Commit Graph

104 Commits

Author SHA1 Message Date
Ed Addario f3323b6503
Save tensor statistics to imatrix file 2026-01-22 15:05:15 +00:00
Ed Addario cb4777e40f
Minor cosmetic code change 2026-01-17 12:01:02 +00:00
Ed Addario b6fc86b32b
Display NaN if statistic is uninterpretable 2026-01-17 11:43:29 +00:00
Ed Addario 2fd301e02c
Don't display layer statistics if there are gaps in the sequence 2026-01-17 11:42:25 +00:00
Ed Addario 91d31bd732
Refactor variable name 2026-01-17 11:41:02 +00:00
Ed Addario a297a158e3
Fix typo 2026-01-11 18:34:10 +00:00
Ed Addario fdc2def79c
Refactor show_statistics() 2026-01-11 17:41:04 +00:00
Ed Addario e69058c6ec
Refactor compute_layer_statistics() 2026-01-11 17:40:29 +00:00
Ed Addario 309dc1231a
Refactor compute_tensor_statistics() 2026-01-11 17:38:47 +00:00
Ed Addario 395367f210
Refactor compute_vector_statistics() 2026-01-11 17:37:17 +00:00
Ed Addario d488bbb7c7
Refactor compute_tensor_averages() 2026-01-11 17:36:10 +00:00
Ed Addario 6d82fa825a
Add intermediate computation variables and Pearson 2026-01-11 17:34:05 +00:00
Ed Addario c3b6685599
Merge branch 'master' into imatrix 2025-12-16 13:57:27 +01:00
Georgi Gerganov 254098a279
common : refactor common_sampler + grammar logic changes (#17937)
* common : refactor common_sampler + grammar logic changes

* tests : increase max_tokens to get needed response

* batched : fix uninitialized samplers
2025-12-14 10:11:13 +02:00
Ed Addario 4a0511f3a0
Remove storing tensor statistics 2025-11-23 22:18:12 +00:00
Ed Addario 8d97eee557
Improve layer 0 stats 2025-11-17 17:52:15 +00:00
Ed Addario bf9823afa7
Minor refactoring 2025-11-17 14:51:12 +00:00
Ed Addario cdc7caea97
Remove unreachable logic 2025-11-17 14:46:45 +00:00
Ed Addario 658c6a8303
Enforce tensor structure when aggregating multiple imatrix files 2025-11-17 14:46:21 +00:00
Ed Addario a2b86d7fd9
Minor refactoring 2025-11-17 14:14:05 +00:00
Ed Addario 1f3db496cc
Calculate layer_sum only for legacy 2025-11-17 13:36:28 +00:00
Ed Addario 76566b83de
Enforce same-size between compared tensors 2025-11-17 13:28:35 +00:00
Ed Addario fb2b09a43c
Skip experts with zero count (unused) 2025-11-17 13:06:37 +00:00
Ed Addario 63cbcc6dfc
Refactor legacy determination 2025-11-17 13:05:34 +00:00
Ed Addario ae1cbc707b
Warn if problem with previous layer 2025-11-17 13:04:16 +00:00
Ed Addario 5384a11b94
Initialise layer and tensor variables 2025-11-17 13:00:47 +00:00
Ed Addario 559ae9ab89
Refactor legacy imatrix handling 2025-11-17 10:19:34 +00:00
Ed Addario b2b7175e19
Fix bug when vectors are zero 2025-11-06 15:12:09 +00:00
Ed Addario ce046dcee8
Save statistics to imatrix 2025-10-30 22:43:46 +00:00
Ed Addario 7d8819f57a
Improve compute_layer_statistics() processing of mismatched tensor sizes 2025-10-29 18:36:01 +00:00
Ed Addario 006e7ef991
Improve compute_vector_statistics() processing of mismatched tensor sizes 2025-10-29 18:35:39 +00:00
Ed Addario 2a6f5d7e60
Refactor variable names 2025-10-29 18:32:47 +00:00
Ed Addario 6ff0a79e54
Minor stats report cosmetic changes 2025-10-29 07:59:40 +00:00
Ed Addario 86fabce58d
Clamp values 2025-10-28 23:10:44 +00:00
Ed Addario ab015065b8
Minor refactoring 2025-10-28 23:10:12 +00:00
Ed Addario 92a42bac3d
Type refactoring 2025-10-28 23:06:29 +00:00
Ed Addario b5068df804
Minor refactoring 2025-10-28 23:03:52 +00:00
Ed Addario 0b0381c94c
Merge Cosine Similarity and L2 Norm computation into single loop 2025-10-28 21:41:31 +00:00
Ed Addario dc4a04b5c5
Adjust size calculation and change fallback value to 0.0f 2025-10-28 21:35:35 +00:00
Ed Addario 683ef8dfb7
Fill zeros for experts with zero counts to preserve shape 2025-10-28 18:35:17 +00:00
Ed Addario 637e674da6
Avoid division by zero on zero-count matrices 2025-10-28 18:33:37 +00:00
Ed Addario c9a0874f35
Clamp CosSim to [-1, 1] to avoid float drift 2025-10-28 18:29:59 +00:00
Ed Addario af3b6aca22
Fix legacy_mode getting overwritten on each tensor bug 2025-10-28 18:27:19 +00:00
Ed Addario 8f1aa7885e
Remove activation_statistics() option 2025-08-31 14:03:19 +01:00
Ed Addario 6371902f98
Add --output-format to usage 2025-08-26 21:53:54 +01:00
Ed Addario 630750fdef
Validate number of elements if in_sum is present 2025-08-17 09:42:18 +01:00
Ed Addario 1f72bc157f
Avoid using if statements with initialiser 2025-08-17 08:35:17 +01:00
Ed Addario f6934b9417
Merge branch 'imatrix' of https://github.com/EAddario/llama.cpp into imatrix 2025-08-17 08:20:18 +01:00
Ed Addario 44ea7ddeac
Change statement order 2025-08-17 08:20:03 +01:00
Ed Addario 2e803234f4
Use { and } around conditionally-executed single line statements 2025-08-17 08:19:02 +01:00