TheBloke
/

mixtralnt-4x7b-test-GGUF

Model card Files Files and versions

mixtralnt-4x7b-test-GGUF

125 GB

1 contributor

History: 24 commits

TheBloke's picture

Delete mixtralnt-4x7b-test.Q5_K_S.gguf

65ab361 almost 2 years ago

.gitattributes

2.33 kB

GGUF model commit (made with llama.cpp commit 8a7b2fa) almost 2 years ago
README.md

13.9 kB

Update README.md almost 2 years ago
config.json

31 Bytes

GGUF model commit (made with llama.cpp commit 8a7b2fa) almost 2 years ago
mixtralnt-4x7b-test.Q2_K.gguf

8.06 GB
xet

GGUF model commit (made with llama.cpp commit 8a7b2fa) almost 2 years ago
mixtralnt-4x7b-test.Q3_K_M.gguf

10.5 GB
xet

GGUF model commit (made with llama.cpp commit 8a7b2fa) almost 2 years ago
mixtralnt-4x7b-test.Q4_0.gguf

13.6 GB
xet

GGUF model commit (made with llama.cpp commit 8a7b2fa) almost 2 years ago
mixtralnt-4x7b-test.Q4_K_M.gguf

13.6 GB
xet

GGUF model commit (made with llama.cpp commit 8a7b2fa) almost 2 years ago
mixtralnt-4x7b-test.Q5_0.gguf

16.6 GB
xet

GGUF model commit (made with llama.cpp commit 8a7b2fa) almost 2 years ago
mixtralnt-4x7b-test.Q5_K_M.gguf

16.6 GB
xet

GGUF model commit (made with llama.cpp commit 8a7b2fa) almost 2 years ago
mixtralnt-4x7b-test.Q6_K.gguf

19.8 GB
xet

GGUF model commit (made with llama.cpp commit 8a7b2fa) almost 2 years ago
mixtralnt-4x7b-test.Q8_0.gguf

25.7 GB
xet

GGUF model commit (made with llama.cpp commit 8a7b2fa) almost 2 years ago