Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

7

Full-text search

Active filters: w8a16

avtc/GLM-4.5-Air-GPTQMODEL-W8A16

Text Generation • 116B • Updated 7 days ago • 28 • 1

thesby/Qwen2.5-VL-7B-NSFW-Caption-V4-W8A16

Text Generation • 4B • Updated Oct 5 • 133 • 3

groxaxo/Huihui-gpt-oss-20b-BF16-abliterated-W8A16

20B • Updated Sep 3 • 118 • 1

groxaxo/gpt-oss-20b-ShiningValiant3-W8A16

Text Generation • 20B • Updated Sep 4 • 57 • 1

TheHouseOfTheDude/Behemoth-ReduX-123B-v1_Compressed-Tensors

Text Generation • Updated Sep 17 • 1

TheHouseOfTheDude/Qwen3-Next-80B-A3B-Instruct_Compressed-Tensors

Text Generation • Updated Sep 19 • 9

TheHouseOfTheDude/KansenSakura-Erosion-RP-12b_Compressed-Tensors

Text Generation • Updated 27 days ago • 32 • 1