Original model: Voxtral-TCR1-4b by Retreatcost
Available EXL3 v0.0.15 quants
| Type | Size | CLI |
|---|---|---|
| H8-4.0BPW | 2.83 GB | Copy-paste the line or Download the batch file |
| H8-6.0BPW | 3.64 GB | Copy-paste the line or Download the batch file |
| H8-8.0BPW | 4.44 GB | Copy-paste the line or Download the batch file |
Requirements: A python installation with huggingface-hub module to use CLI.
Model tree for DeathGodlike/Voxtral-TCR1-4b_EXL3
Base model
mistralai/Voxtral-Mini-3B-2507
Finetuned
Leoxxxxh/Voxtral-Mini-3B-2507-TextOnly
Finetuned
Retreatcost/Voxtral-TCR1-4b