mradermacher
/

Josiefied-Qwen2.5-3B-Instruct-abliterated-v1-i1-GGUF

Model card Files Files and versions

Josiefied-Qwen2.5-3B-Instruct-abliterated-v1-i1-GGUF

40.3 GB

1 contributor

History: 4 commits

mradermacher's picture

auto-patch README.md

6a7844f verified 9 months ago

.gitattributes

3.81 kB

uploaded from rich1 9 months ago
Josiefied-Qwen2.5-3B-Instruct-abliterated-v1.i1-IQ1_M.gguf

952 MB
xet

uploaded from rich1 9 months ago
Josiefied-Qwen2.5-3B-Instruct-abliterated-v1.i1-IQ1_S.gguf

893 MB
xet

uploaded from rich1 9 months ago
Josiefied-Qwen2.5-3B-Instruct-abliterated-v1.i1-IQ2_M.gguf

1.27 GB
xet

uploaded from rich1 9 months ago
Josiefied-Qwen2.5-3B-Instruct-abliterated-v1.i1-IQ2_S.gguf

1.2 GB
xet

uploaded from rich1 9 months ago
Josiefied-Qwen2.5-3B-Instruct-abliterated-v1.i1-IQ2_XS.gguf

1.13 GB
xet

uploaded from rich1 9 months ago
Josiefied-Qwen2.5-3B-Instruct-abliterated-v1.i1-IQ2_XXS.gguf

1.05 GB
xet

uploaded from rich1 9 months ago
Josiefied-Qwen2.5-3B-Instruct-abliterated-v1.i1-IQ3_M.gguf

1.62 GB
xet

uploaded from rich1 9 months ago
Josiefied-Qwen2.5-3B-Instruct-abliterated-v1.i1-IQ3_S.gguf

1.59 GB
xet

uploaded from rich1 9 months ago
Josiefied-Qwen2.5-3B-Instruct-abliterated-v1.i1-IQ3_XS.gguf

1.53 GB
xet

uploaded from rich1 9 months ago
Josiefied-Qwen2.5-3B-Instruct-abliterated-v1.i1-IQ3_XXS.gguf

1.42 GB
xet

uploaded from rich1 9 months ago
Josiefied-Qwen2.5-3B-Instruct-abliterated-v1.i1-IQ4_NL.gguf

2 GB
xet

uploaded from rich1 9 months ago
Josiefied-Qwen2.5-3B-Instruct-abliterated-v1.i1-IQ4_XS.gguf

1.9 GB
xet

uploaded from rich1 9 months ago
Josiefied-Qwen2.5-3B-Instruct-abliterated-v1.i1-Q2_K.gguf

1.38 GB
xet

uploaded from rich1 9 months ago
Josiefied-Qwen2.5-3B-Instruct-abliterated-v1.i1-Q2_K_S.gguf

1.3 GB
xet

uploaded from rich1 9 months ago
Josiefied-Qwen2.5-3B-Instruct-abliterated-v1.i1-Q3_K_L.gguf

1.84 GB
xet

uploaded from rich1 9 months ago
Josiefied-Qwen2.5-3B-Instruct-abliterated-v1.i1-Q3_K_M.gguf

1.72 GB
xet

uploaded from rich1 9 months ago
Josiefied-Qwen2.5-3B-Instruct-abliterated-v1.i1-Q3_K_S.gguf

1.59 GB
xet

uploaded from rich1 9 months ago
Josiefied-Qwen2.5-3B-Instruct-abliterated-v1.i1-Q4_0.gguf

2 GB
xet

uploaded from rich1 9 months ago
Josiefied-Qwen2.5-3B-Instruct-abliterated-v1.i1-Q4_1.gguf

2.19 GB
xet

uploaded from rich1 9 months ago
Josiefied-Qwen2.5-3B-Instruct-abliterated-v1.i1-Q4_K_M.gguf

2.1 GB
xet

uploaded from rich1 9 months ago
Josiefied-Qwen2.5-3B-Instruct-abliterated-v1.i1-Q4_K_S.gguf

2.01 GB
xet

uploaded from rich1 9 months ago
Josiefied-Qwen2.5-3B-Instruct-abliterated-v1.i1-Q5_K_M.gguf

2.44 GB
xet

uploaded from rich1 9 months ago
Josiefied-Qwen2.5-3B-Instruct-abliterated-v1.i1-Q5_K_S.gguf

2.38 GB
xet

uploaded from rich1 9 months ago
Josiefied-Qwen2.5-3B-Instruct-abliterated-v1.i1-Q6_K.gguf

2.79 GB
xet

uploaded from rich1 9 months ago
README.md

6.79 kB

auto-patch README.md 9 months ago