chore: Add tiktoken to convert requirements

Signed-off-by: teleprint-me <77757836+teleprint-me@users.noreply.github.com>
2024-05-08 13:48:52 -04:00 · 2024-05-08 13:48:52 -04:00 · 0478552610
parent 906c3f73d5
commit 0478552610
1 changed files with 1 additions and 0 deletions
--- a/requirements/requirements-convert-hf-to-gguf-update.txt
+++ b/requirements/requirements-convert-hf-to-gguf-update.txt
@ -1,3 +1,4 @@
 -r ./requirements-convert.txt
 torch~=2.1.1
 einops~=0.7.0
+tiktoken~=0.6.0