Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
unsloth
/
granite-4.0-h-350m-GGUF
like
7
Follow
Unsloth AI
10.6k
Transformers
GGUF
language
unsloth
granite-4.0
conversational
arxiv:
0000.00000
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
d576389
granite-4.0-h-350m-GGUF
5.42 GB
1 contributor
History:
28 commits
danielhanchen
Upload folder using huggingface_hub
d576389
verified
21 days ago
.gitattributes
3.08 kB
Upload folder using huggingface_hub
21 days ago
README.md
Safe
34 kB
Upload folder using huggingface_hub
21 days ago
granite-4.0-h-350m-IQ4_NL.gguf
Safe
216 MB
xet
Upload folder using huggingface_hub
21 days ago
granite-4.0-h-350m-IQ4_XS.gguf
Safe
208 MB
xet
Upload folder using huggingface_hub
21 days ago
granite-4.0-h-350m-Q2_K.gguf
160 MB
xet
Upload folder using huggingface_hub
21 days ago
granite-4.0-h-350m-Q2_K_L.gguf
160 MB
xet
Upload folder using huggingface_hub
21 days ago
granite-4.0-h-350m-Q3_K_M.gguf
Safe
189 MB
xet
Upload folder using huggingface_hub
21 days ago
granite-4.0-h-350m-Q3_K_S.gguf
Safe
181 MB
xet
Upload folder using huggingface_hub
21 days ago
granite-4.0-h-350m-Q4_0.gguf
Safe
216 MB
xet
Upload folder using huggingface_hub
21 days ago
granite-4.0-h-350m-Q4_1.gguf
Safe
233 MB
xet
Upload folder using huggingface_hub
21 days ago
granite-4.0-h-350m-Q4_K_M.gguf
Safe
223 MB
xet
Upload folder using huggingface_hub
21 days ago
granite-4.0-h-350m-Q4_K_S.gguf
Safe
217 MB
xet
Upload folder using huggingface_hub
21 days ago
granite-4.0-h-350m-Q5_K_M.gguf
Safe
252 MB
xet
Upload folder using huggingface_hub
21 days ago
granite-4.0-h-350m-Q5_K_S.gguf
Safe
249 MB
xet
Upload folder using huggingface_hub
21 days ago
granite-4.0-h-350m-Q6_K.gguf
Safe
284 MB
xet
Upload folder using huggingface_hub
21 days ago
granite-4.0-h-350m-Q8_0.gguf
Safe
366 MB
xet
Upload folder using huggingface_hub
21 days ago
granite-4.0-h-350m-UD-IQ1_M.gguf
119 MB
xet
Upload folder using huggingface_hub
21 days ago
granite-4.0-h-350m-UD-IQ1_S.gguf
113 MB
xet
Upload folder using huggingface_hub
21 days ago
granite-4.0-h-350m-UD-IQ2_M.gguf
145 MB
xet
Upload folder using huggingface_hub
21 days ago
granite-4.0-h-350m-UD-IQ2_XXS.gguf
128 MB
xet
Upload folder using huggingface_hub
21 days ago
granite-4.0-h-350m-UD-IQ3_XXS.gguf
Safe
160 MB
xet
Upload folder using huggingface_hub
21 days ago
granite-4.0-h-350m-UD-Q2_K_XL.gguf
162 MB
xet
Upload folder using huggingface_hub
21 days ago
granite-4.0-h-350m-UD-Q3_K_XL.gguf
191 MB
xet
Upload folder using huggingface_hub
21 days ago
granite-4.0-h-350m-UD-Q4_K_XL.gguf
225 MB
xet
Upload folder using huggingface_hub
21 days ago
granite-4.0-h-350m-UD-Q5_K_XL.gguf
253 MB
xet
Upload folder using huggingface_hub
21 days ago
granite-4.0-h-350m-UD-Q6_K_XL.gguf
311 MB
xet
Upload folder using huggingface_hub
21 days ago
granite-4.0-h-350m-UD-Q8_K_XL.gguf
461 MB
xet
Upload folder using huggingface_hub
21 days ago
imatrix_unsloth.gguf_file
792 kB
xet
Upload folder using huggingface_hub
21 days ago
