* Add support for stablelm-3b-4e1t * Supports GPU offloading of (n-1) layers |
||
|---|---|---|
| .. | ||
| __init__.py | ||
| constants.py | ||
| gguf.py | ||
| gguf_reader.py | ||
| gguf_writer.py | ||
| py.typed | ||
| tensor_mapping.py | ||
| vocab.py | ||
* Add support for stablelm-3b-4e1t * Supports GPU offloading of (n-1) layers |
||
|---|---|---|
| .. | ||
| __init__.py | ||
| constants.py | ||
| gguf.py | ||
| gguf_reader.py | ||
| gguf_writer.py | ||
| py.typed | ||
| tensor_mapping.py | ||
| vocab.py | ||