Commit Graph

20 Commits

Author SHA1 Message Date
teleprint-me 2fa2c7a86c
chore: Move enums and model map to constants 2024-05-20 14:51:03 -04:00
teleprint-me 18bb36e496
chore: Allow the user to config the logger 2024-05-20 14:06:21 -04:00
teleprint-me a1951e27dc
refactor: Add proper names for remote model references 2024-05-20 01:36:44 -04:00
teleprint-me 381dad5eb3
fix: Add missing model architectures 2024-05-20 00:50:42 -04:00
teleprint-me 9a2834e24e
fix: Use __name__ as logger name 2024-05-19 22:39:30 -04:00
teleprint-me 89a46fe818
feat: Attempt to mirror the llama.cpp API for compatibility 2024-05-19 22:31:05 -04:00
teleprint-me 0479e9695f
patch: Add exception handling for non-existent vocab related files 2024-05-18 22:14:19 -04:00
teleprint-me 006bb60d27
chore: Fix model path references 2024-05-18 19:20:19 -04:00
teleprint-me 2ef73ee6e4
refactor: Apply SoC for HF requests, vocab, and weights 2024-05-18 13:45:21 -04:00
teleprint-me 5eda2c9485
feat: Add pre-tokenizer logging 2024-05-18 13:21:22 -04:00
teleprint-me b2ca23c746
feat: Add method for generating the checksums and writing the results to a json file 2024-05-18 01:46:13 -04:00
teleprint-me 302258721b
refactor: Apply model schema to tokenizer downloads
- Add imports for json and hashlib
- Add missing models: phi, stablelm, mistral, and mixtral
- Fix constructor logic
- Fix how models are accessed
- Apply model schema to download_model method
2024-05-18 01:26:39 -04:00
teleprint-me f7515abf49
feat: Add tokenizer types, model types, and model repos 2024-05-18 00:37:19 -04:00
teleprint-me 1a286c8e21
refactor: Clean up variable names and separate concerns when downloading tokenizers 2024-05-17 23:27:30 -04:00
teleprint-me 5c8144e645
feat: Add download_model method and fix references for clarity to mitigate confusion 2024-05-17 23:00:12 -04:00
teleprint-me 4790f76740
feat: Add prototype for requesting vocab related files 2024-05-17 21:08:39 -04:00
teleprint-me 98cf788990
patch: Apply minor fixes for handling headers and writing content 2024-05-17 21:07:51 -04:00
teleprint-me 742abebb39
refactor: Add log for status and fix url path variable name 2024-05-17 20:37:59 -04:00
teleprint-me ba13d64bb3
feat: Add utils for logging and writing when interacting with HuggingFaceHub 2024-05-17 20:26:21 -04:00
teleprint-me dbdf6c2b1d
feat: Add prototype for managing huggingface hub content 2024-05-17 20:00:48 -04:00