mradermacher
/

Huihui-Mistral-Small-3.2-24B-Instruct-2506-abliterated-llamacppfixed-GGUF

Model card Files Files and versions

Huihui-Mistral-Small-3.2-24B-Instruct-2506-abliterated-llamacppfixed-GGUF

163 GB

1 contributor

History: 16 commits

mradermacher's picture

uploaded from nico1

4b44476 verified 5 months ago

.gitattributes

3.04 kB

uploaded from nico1 5 months ago
Huihui-Mistral-Small-3.2-24B-Instruct-2506-abliterated-llamacppfixed.IQ4_XS.gguf

12.9 GB
xet

uploaded from nico1 5 months ago
Huihui-Mistral-Small-3.2-24B-Instruct-2506-abliterated-llamacppfixed.Q2_K.gguf

8.89 GB
xet

uploaded from nico1 5 months ago
Huihui-Mistral-Small-3.2-24B-Instruct-2506-abliterated-llamacppfixed.Q3_K_L.gguf

12.4 GB
xet

uploaded from nico1 5 months ago
Huihui-Mistral-Small-3.2-24B-Instruct-2506-abliterated-llamacppfixed.Q3_K_M.gguf

11.5 GB
xet

uploaded from nico1 5 months ago
Huihui-Mistral-Small-3.2-24B-Instruct-2506-abliterated-llamacppfixed.Q3_K_S.gguf

10.4 GB
xet

uploaded from nico1 5 months ago
Huihui-Mistral-Small-3.2-24B-Instruct-2506-abliterated-llamacppfixed.Q4_K_M.gguf

14.3 GB
xet

uploaded from nico1 5 months ago
Huihui-Mistral-Small-3.2-24B-Instruct-2506-abliterated-llamacppfixed.Q4_K_S.gguf

13.5 GB
xet

uploaded from nico1 5 months ago
Huihui-Mistral-Small-3.2-24B-Instruct-2506-abliterated-llamacppfixed.Q5_K_M.gguf

16.8 GB
xet

uploaded from nico1 5 months ago
Huihui-Mistral-Small-3.2-24B-Instruct-2506-abliterated-llamacppfixed.Q5_K_S.gguf

16.3 GB
xet

uploaded from nico1 5 months ago
Huihui-Mistral-Small-3.2-24B-Instruct-2506-abliterated-llamacppfixed.Q6_K.gguf

19.3 GB
xet

uploaded from nico1 5 months ago
Huihui-Mistral-Small-3.2-24B-Instruct-2506-abliterated-llamacppfixed.Q8_0.gguf

25.1 GB
xet

uploaded from nico1 5 months ago
Huihui-Mistral-Small-3.2-24B-Instruct-2506-abliterated-llamacppfixed.mmproj-Q8_0.gguf

467 MB
xet

uploaded from nico1 5 months ago
Huihui-Mistral-Small-3.2-24B-Instruct-2506-abliterated-llamacppfixed.mmproj-f16.gguf

878 MB
xet

uploaded from nico1 5 months ago
README.md

3.36 kB

auto-patch README.md 5 months ago