unsloth
/

granite-4.0-micro-GGUF

Model card Files Files and versions

granite-4.0-micro-GGUF

56.8 GB

2 contributors

History: 65 commits

danielhanchen's picture

Create params

3fd2564 verified about 2 months ago

.gitattributes

3.32 kB

Upload folder using huggingface_hub about 2 months ago
README.md

36.2 kB

Update README.md about 2 months ago
granite-4.0-micro-BF16.gguf

6.81 GB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-micro-IQ4_NL.gguf

1.99 GB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-micro-IQ4_XS.gguf

1.89 GB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-micro-Q2_K.gguf

1.37 GB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-micro-Q2_K_L.gguf

1.37 GB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-micro-Q3_K_M.gguf

1.73 GB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-micro-Q3_K_S.gguf

1.57 GB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-micro-Q4_0.gguf

1.99 GB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-micro-Q4_1.gguf

2.18 GB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-micro-Q4_K_M.gguf

2.1 GB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-micro-Q4_K_S.gguf

2 GB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-micro-Q5_K_M.gguf

2.44 GB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-micro-Q5_K_S.gguf

2.38 GB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-micro-Q6_K.gguf

2.8 GB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-micro-Q8_0.gguf

3.62 GB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-micro-UD-IQ1_M.gguf

939 MB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-micro-UD-IQ1_S.gguf

882 MB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-micro-UD-IQ2_M.gguf

1.27 GB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-micro-UD-IQ2_XXS.gguf

1.04 GB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-micro-UD-IQ3_XXS.gguf

1.4 GB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-micro-UD-Q2_K_XL.gguf

1.4 GB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-micro-UD-Q3_K_XL.gguf

1.77 GB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-micro-UD-Q4_K_XL.gguf

2.14 GB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-micro-UD-Q5_K_XL.gguf

2.45 GB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-micro-UD-Q6_K_XL.gguf

3.05 GB
xet

Upload folder using huggingface_hub about 2 months ago
granite-4.0-micro-UD-Q8_K_XL.gguf

4.24 GB
xet

Upload folder using huggingface_hub about 2 months ago
imatrix_unsloth.gguf_file

3.81 MB
xet

Upload folder using huggingface_hub about 2 months ago
params

93 Bytes

Create params about 2 months ago
template

7.08 kB

Update template about 2 months ago