DeathGodlike
/

Neuro-SynthPersonaEngine-24B_EXL3

Text Generation

4-bit precision

8-bit precision

Model card Files Files and versions

DeathGodlike commited on 25 days ago

Commit

de99558

·

verified ·

1 Parent(s): 95af06c

Upload README.md

Files changed (1) hide show

README.md +5 -5

README.md CHANGED Viewed

@@ -15,11 +15,11 @@ tags:
 ## Available [EXL3](https://github.com/turboderp-org/exllamav3) v0.0.15 quants
-| Type | CLI |
-|------|---------|
-| [H8-4.0BPW](https://huggingface.co/DeathGodlike/Neuro-SynthPersonaEngine-24B_EXL3/tree/H8-4.0BPW) | [Copy-paste the line or Download the batch file](https://huggingface.co/DeathGodlike/Neuro-SynthPersonaEngine-24B_EXL3/resolve/H8-4.0BPW/Download~MrRikyz_Neuro-SynthPersonaEngine-24B_H8-4.0BPW_EXL3.bat) |
-| [H8-6.0BPW](https://huggingface.co/DeathGodlike/Neuro-SynthPersonaEngine-24B_EXL3/tree/H8-6.0BPW) | [Copy-paste the line or Download the batch file](https://huggingface.co/DeathGodlike/Neuro-SynthPersonaEngine-24B_EXL3/resolve/H8-6.0BPW/Download~MrRikyz_Neuro-SynthPersonaEngine-24B_H8-6.0BPW_EXL3.bat) |
-| [H8-8.0BPW](https://huggingface.co/DeathGodlike/Neuro-SynthPersonaEngine-24B_EXL3/tree/H8-8.0BPW) | [Copy-paste the line or Download the batch file](https://huggingface.co/DeathGodlike/Neuro-SynthPersonaEngine-24B_EXL3/resolve/H8-8.0BPW/Download~MrRikyz_Neuro-SynthPersonaEngine-24B_H8-8.0BPW_EXL3.bat) |
 ***Requirements: A python installation with huggingface-hub module to use CLI.***

 ## Available [EXL3](https://github.com/turboderp-org/exllamav3) v0.0.15 quants
+| Type | Size | CLI |
+|------|------|---------|
+| [H8-4.0BPW](https://huggingface.co/DeathGodlike/Neuro-SynthPersonaEngine-24B_EXL3/tree/H8-4.0BPW) | 13.16 GB | [Copy-paste the line or Download the batch file](https://huggingface.co/DeathGodlike/Neuro-SynthPersonaEngine-24B_EXL3/resolve/H8-4.0BPW/Download~MrRikyz_Neuro-SynthPersonaEngine-24B_H8-4.0BPW_EXL3.bat) |
+| [H8-6.0BPW](https://huggingface.co/DeathGodlike/Neuro-SynthPersonaEngine-24B_EXL3/tree/H8-6.0BPW) | 18.72 GB | [Copy-paste the line or Download the batch file](https://huggingface.co/DeathGodlike/Neuro-SynthPersonaEngine-24B_EXL3/resolve/H8-6.0BPW/Download~MrRikyz_Neuro-SynthPersonaEngine-24B_H8-6.0BPW_EXL3.bat) |
+| [H8-8.0BPW](https://huggingface.co/DeathGodlike/Neuro-SynthPersonaEngine-24B_EXL3/tree/H8-8.0BPW) | 24.27 GB | [Copy-paste the line or Download the batch file](https://huggingface.co/DeathGodlike/Neuro-SynthPersonaEngine-24B_EXL3/resolve/H8-8.0BPW/Download~MrRikyz_Neuro-SynthPersonaEngine-24B_H8-8.0BPW_EXL3.bat) |
 ***Requirements: A python installation with huggingface-hub module to use CLI.***