fa85ba6ae3
preliminary template/multiprompt support
...
model is running out of context and that ought to be fixed (segfaulting) but other than that it looks goodish
2024-05-30 23:39:59 -04:00
31f153fe9c
fix matrix transpose multiplication
...
you have got to be kidding me
2024-05-30 21:36:17 -04:00
d446c6d887
add debugs
2024-05-31 00:41:12 +02:00
287da25f48
fix mem error
2024-05-31 00:06:45 +02:00
447023fc43
add multi prompts, multi-thread for PCA
2024-05-30 23:58:32 +02:00
dc46264ff0
example template completions
...
Implements an example template set built from the positive/negative prompts like the control vector Python implementation.
2024-05-30 13:12:54 -04:00
f58f6af133
param parsing, refactor, comments
...
Added basic command-line parameters for outfile and one each positive/negative prompt.
Refactored some messy code in PCA computation and GGUF exporting.
Left a bunch of comments regarding further work needed.
2024-05-30 11:31:45 -04:00
73747fe8eb
proof-of-concept stdlib implementation
...
Implements PCA and file writing using mostly standard libraries. The output is recognized as a functional control vector, but outputs gibberish.
2024-05-30 00:31:29 -04:00
b30bea3257
add comments
2024-05-24 22:50:03 +02:00
c31c118d86
calc diff
2024-05-24 11:46:47 +02:00
0a46d73056
add control-vector-generator
2024-05-24 11:11:55 +02:00
Christian Zhou-Zheng
ngxson