Commit Graph

3 Commits

Author SHA1 Message Date
ngxson 64cad20c2e change compile target to llama-cvector-generator 2024-06-13 14:51:11 +02:00
Christian Zhou-Zheng 4d88cd1af1 fix zero output & param parsing, functional templating
fixed a bug where the output file had no tensor data/was all zero

fixed a bug where single hyphen flags were not being correctly parsed

implements creation of templated prompts from input (still need to adapt based on model)
2024-05-31 12:40:35 -04:00
Christian Zhou-Zheng fa85ba6ae3 preliminary template/multiprompt support
model is running out of context and that ought to be fixed (segfaulting) but other than that it looks goodish
2024-05-30 23:39:59 -04:00