mradermacher
/

Dumpling-Mistral-Nemo-8B-i1-GGUF

Model card Files Files and versions

Dumpling-Mistral-Nemo-8B-i1-GGUF

75.4 GB

1 contributor

History: 22 commits

mradermacher's picture

uploaded from rich1

38c7dd8 verified 10 months ago

.gitattributes

3 kB

uploaded from rich1 10 months ago
Dumpling-Mistral-Nemo-8B.i1-IQ1_M.gguf

2.33 GB
xet

uploaded from rich1 10 months ago
Dumpling-Mistral-Nemo-8B.i1-IQ1_S.gguf

2.19 GB
xet

uploaded from rich1 10 months ago
Dumpling-Mistral-Nemo-8B.i1-IQ2_M.gguf

3.15 GB
xet

uploaded from rich1 10 months ago
Dumpling-Mistral-Nemo-8B.i1-IQ2_S.gguf

2.95 GB
xet

uploaded from rich1 10 months ago
Dumpling-Mistral-Nemo-8B.i1-IQ2_XS.gguf

2.79 GB
xet

uploaded from rich1 10 months ago
Dumpling-Mistral-Nemo-8B.i1-IQ2_XXS.gguf

2.58 GB
xet

uploaded from rich1 10 months ago
Dumpling-Mistral-Nemo-8B.i1-IQ3_M.gguf

4.01 GB
xet

uploaded from rich1 10 months ago
Dumpling-Mistral-Nemo-8B.i1-IQ3_XXS.gguf

3.48 GB
xet

uploaded from rich1 10 months ago
Dumpling-Mistral-Nemo-8B.i1-IQ4_NL.gguf

4.94 GB
xet

uploaded from rich1 10 months ago
Dumpling-Mistral-Nemo-8B.i1-IQ4_XS.gguf

4.7 GB
xet

uploaded from rich1 10 months ago
Dumpling-Mistral-Nemo-8B.i1-Q2_K.gguf

3.39 GB
xet

uploaded from rich1 10 months ago
Dumpling-Mistral-Nemo-8B.i1-Q2_K_S.gguf

3.19 GB
xet

uploaded from rich1 10 months ago
Dumpling-Mistral-Nemo-8B.i1-Q3_K_L.gguf

4.56 GB
xet

uploaded from rich1 10 months ago
Dumpling-Mistral-Nemo-8B.i1-Q3_K_M.gguf

4.25 GB
xet

uploaded from rich1 10 months ago
Dumpling-Mistral-Nemo-8B.i1-Q3_K_S.gguf

3.89 GB
xet

uploaded from rich1 10 months ago
Dumpling-Mistral-Nemo-8B.i1-Q4_K_M.gguf

5.19 GB
xet

uploaded from rich1 10 months ago
Dumpling-Mistral-Nemo-8B.i1-Q4_K_S.gguf

4.95 GB
xet

uploaded from rich1 10 months ago
Dumpling-Mistral-Nemo-8B.i1-Q5_K_S.gguf

5.89 GB
xet

uploaded from rich1 10 months ago
Dumpling-Mistral-Nemo-8B.i1-Q6_K.gguf

6.92 GB
xet

uploaded from rich1 10 months ago
README.md

243 Bytes

uploaded from rich1 10 months ago
imatrix.dat

4.59 MB
xet

uploaded from rich1 10 months ago