mradermacher
/

Qwen2.5-0.5B-Instruct-abliterated-v3-i1-GGUF

Model card Files Files and versions

Qwen2.5-0.5B-Instruct-abliterated-v3-i1-GGUF

8.57 GB

1 contributor

History: 5 commits

mradermacher's picture

auto-patch README.md

0d00433 verified 8 months ago

.gitattributes

3.67 kB

uploaded from rain 8 months ago
Qwen2.5-0.5B-Instruct-abliterated-v3.i1-IQ1_M.gguf

318 MB
xet

uploaded from rain 8 months ago
Qwen2.5-0.5B-Instruct-abliterated-v3.i1-IQ1_S.gguf

316 MB
xet

uploaded from rain 8 months ago
Qwen2.5-0.5B-Instruct-abliterated-v3.i1-IQ2_M.gguf

329 MB
xet

uploaded from rain 8 months ago
Qwen2.5-0.5B-Instruct-abliterated-v3.i1-IQ2_S.gguf

326 MB
xet

uploaded from rain 8 months ago
Qwen2.5-0.5B-Instruct-abliterated-v3.i1-IQ2_XS.gguf

324 MB
xet

uploaded from rain 8 months ago
Qwen2.5-0.5B-Instruct-abliterated-v3.i1-IQ2_XXS.gguf

322 MB
xet

uploaded from rain 8 months ago
Qwen2.5-0.5B-Instruct-abliterated-v3.i1-IQ3_M.gguf

343 MB
xet

uploaded from rain 8 months ago
Qwen2.5-0.5B-Instruct-abliterated-v3.i1-IQ3_S.gguf

339 MB
xet

uploaded from rain 8 months ago
Qwen2.5-0.5B-Instruct-abliterated-v3.i1-IQ3_XS.gguf

339 MB
xet

uploaded from rain 8 months ago
Qwen2.5-0.5B-Instruct-abliterated-v3.i1-IQ3_XXS.gguf

334 MB
xet

uploaded from rain 8 months ago
Qwen2.5-0.5B-Instruct-abliterated-v3.i1-IQ4_NL.gguf

353 MB
xet

uploaded from rain 8 months ago
Qwen2.5-0.5B-Instruct-abliterated-v3.i1-IQ4_XS.gguf

349 MB
xet

uploaded from rain 8 months ago
Qwen2.5-0.5B-Instruct-abliterated-v3.i1-Q2_K.gguf

339 MB
xet

uploaded from rain 8 months ago
Qwen2.5-0.5B-Instruct-abliterated-v3.i1-Q2_K_S.gguf

331 MB
xet

uploaded from rain 8 months ago
Qwen2.5-0.5B-Instruct-abliterated-v3.i1-Q3_K_L.gguf

369 MB
xet

uploaded from rain 8 months ago
Qwen2.5-0.5B-Instruct-abliterated-v3.i1-Q3_K_M.gguf

355 MB
xet

uploaded from rain 8 months ago
Qwen2.5-0.5B-Instruct-abliterated-v3.i1-Q3_K_S.gguf

338 MB
xet

uploaded from rain 8 months ago
Qwen2.5-0.5B-Instruct-abliterated-v3.i1-Q4_0.gguf

353 MB
xet

uploaded from rain 8 months ago
Qwen2.5-0.5B-Instruct-abliterated-v3.i1-Q4_1.gguf

375 MB
xet

uploaded from rain 8 months ago
Qwen2.5-0.5B-Instruct-abliterated-v3.i1-Q4_K_M.gguf

398 MB
xet

uploaded from rain 8 months ago
Qwen2.5-0.5B-Instruct-abliterated-v3.i1-Q4_K_S.gguf

385 MB
xet

uploaded from rain 8 months ago
Qwen2.5-0.5B-Instruct-abliterated-v3.i1-Q5_K_M.gguf

420 MB
xet

uploaded from rain 8 months ago
Qwen2.5-0.5B-Instruct-abliterated-v3.i1-Q5_K_S.gguf

413 MB
xet

uploaded from rain 8 months ago
Qwen2.5-0.5B-Instruct-abliterated-v3.i1-Q6_K.gguf

506 MB
xet

uploaded from rain 8 months ago
README.md

6.52 kB

auto-patch README.md 8 months ago
imatrix.dat

989 kB
xet

uploaded from rain 8 months ago