---
license: gemma
pipeline_tag: sentence-similarity
library_name: sentence-transformers
tags:
- sentence-transformers
- sentence-similarity
- feature-extraction
- llama-cpp
- gguf-my-repo
extra_gated_heading: Access EmbeddingGemma on Hugging Face
extra_gated_prompt: To access EmbeddingGemma on Hugging Face, you’re required to review
  and agree to Google’s usage license. To do this, please ensure you’re logged in
  to Hugging Face and click below. Requests are processed immediately.
extra_gated_button_content: Acknowledge license
base_model: google/embeddinggemma-300m-qat-q4_0-unquantized
---

# embeddinggemma-300m-qat
**Model creator:** [google](https://huggingface.co/google)<br/>
**Original model**: [google/embeddinggemma-300m-qat-q4_0-unquantized](https://huggingface.co/google/embeddinggemma-300m-qat-q4_0-unquantized)<br/>
**GGUF quantization:** provided by [olegshulyakov](https:/huggingface.co/olegshulyakov) using `llama.cpp`<br/>
## Special thanks
🙏 Special thanks to [Georgi Gerganov](https://github.com/ggerganov) and the whole team working on [llama.cpp](https://github.com/ggerganov/llama.cpp/) for making all of this possible.
## Use with Ollama
```bash
ollama run "hf.co/olegshulyakov/embeddinggemma-300m-qat-GGUF:Q4_0"
```
## Use with LM Studio
```bash
lms load "olegshulyakov/embeddinggemma-300m-qat-GGUF"
```
## Use with llama.cpp CLI
```bash
llama-cli --hf "olegshulyakov/embeddinggemma-300m-qat-GGUF:Q4_0" -p "The meaning to life and the universe is"
```
## Use with llama.cpp Server:
```bash
llama-server --hf "olegshulyakov/embeddinggemma-300m-qat-GGUF:Q4_0" -c 4096
```