Commit Graph

3 Commits

Author SHA1 Message Date
Manuel Schmid 62fe86f1e8
chore: always use cpu as default device
this is overridden anyways
2024-01-26 02:34:25 +01:00
Manuel Schmid d515d0f074
fix: remove unnecessary fp32 / fp16 handling 2024-01-26 02:06:17 +01:00
Manuel Schmid 90be73a6df
feat: add model patching
automatically unload model when not needed anymore
2024-01-26 02:05:38 +01:00