happyz
/
llama.cpp
mirror of https://github.com/ggerganov/llama.cpp.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

model-conversion : add --embeddings flag to modelcard.template [no ci] (#15801) 

This commit updates the modelcard.template file used in the model
conversion scripts for embedding models to include the llama-server
--embeddings flag in the recommended command to run the model.

The motivation for this change was that when using the model-conversion
"tool" to upload the EmbeddingGemma models to Hugging Face this flag was
missing and the embedding endpoint was there for not available when
copy&pasting the command.
This commit is contained in:
Daniel Bevenius 2025-09-05 04:36:23 +02:00 committed by GitHub
parent 4fd1242bef
commit 5d6688de08
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
examples/model-conversion/scripts/embedding/modelcard.template
View File

@ -7,7 +7,7 @@ base_model:
Recommended way to run this model: Recommended way to run this model:
```sh ```sh
llama-server -hf {namespace}/{model_name}-GGUF llama-server -hf {namespace}/{model_name}-GGUF --embeddings
``` ```
Then the endpoint can be accessed at http://localhost:8080/embedding, for Then the endpoint can be accessed at http://localhost:8080/embedding, for