metadata
license: gemma
pipeline_tag: sentence-similarity
library_name: sentence-transformers
tags:
- sentence-transformers
- sentence-similarity
- feature-extraction
- llama-cpp
- gguf-my-repo
extra_gated_heading: Access EmbeddingGemma on Hugging Face
extra_gated_prompt: >-
To access EmbeddingGemma on Hugging Face, you’re required to review and agree
to Google’s usage license. To do this, please ensure you’re logged in to
Hugging Face and click below. Requests are processed immediately.
extra_gated_button_content: Acknowledge license
base_model: google/embeddinggemma-300m-qat-q4_0-unquantized
embeddinggemma-300m-qat
Model creator: google
Original model: google/embeddinggemma-300m-qat-q4_0-unquantized
GGUF quantization: provided by olegshulyakov using llama.cpp
Special thanks
🙏 Special thanks to Georgi Gerganov and the whole team working on llama.cpp for making all of this possible.
Use with Ollama
ollama run "hf.co/olegshulyakov/embeddinggemma-300m-qat-GGUF:Q4_0"
Use with LM Studio
lms load "olegshulyakov/embeddinggemma-300m-qat-GGUF"
Use with llama.cpp CLI
llama-cli --hf "olegshulyakov/embeddinggemma-300m-qat-GGUF:Q4_0" -p "The meaning to life and the universe is"
Use with llama.cpp Server:
llama-server --hf "olegshulyakov/embeddinggemma-300m-qat-GGUF:Q4_0" -c 4096