unsloth
/

gemma-3-4b-it-qat-GGUF

Image-Text-to-Text

Model card Files Files and versions

gemma-3-4b-it-qat-GGUF

73.2 GB

3 contributors

History: 38 commits

danielhanchen's picture

Upload folder using huggingface_hub

5b7eac5 verified 7 months ago

.gitattributes

3.54 kB

Upload folder using huggingface_hub 7 months ago
README.md

25 kB

Update README.md 7 months ago
config.json

1.66 kB

Upload folder using huggingface_hub 7 months ago
gemma-3-4b-it-qat-BF16.gguf

7.77 GB
xet

Add files using upload-large-folder tool 7 months ago
gemma-3-4b-it-qat-IQ4_NL.gguf

2.36 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-4b-it-qat-IQ4_XS.gguf

2.26 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-4b-it-qat-Q2_K.gguf

1.73 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-4b-it-qat-Q2_K_L.gguf

1.73 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-4b-it-qat-Q3_K_M.gguf

2.1 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-4b-it-qat-Q3_K_S.gguf

1.94 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-4b-it-qat-Q4_0.gguf

2.37 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-4b-it-qat-Q4_1.gguf

2.56 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-4b-it-qat-Q4_K_M.gguf

2.49 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-4b-it-qat-Q4_K_S.gguf

2.38 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-4b-it-qat-Q5_K_M.gguf

2.83 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-4b-it-qat-Q5_K_S.gguf

2.76 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-4b-it-qat-Q6_K.gguf

3.19 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-4b-it-qat-Q8_0.gguf

4.13 GB
xet

Add files using upload-large-folder tool 7 months ago
gemma-3-4b-it-qat-UD-IQ1_M.gguf

1.24 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-4b-it-qat-UD-IQ1_S.gguf

1.18 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-4b-it-qat-UD-IQ2_M.gguf

1.57 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-4b-it-qat-UD-IQ2_XXS.gguf

1.34 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-4b-it-qat-UD-IQ3_XXS.gguf

1.71 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-4b-it-qat-UD-IQ4_XS.gguf

2.18 GB
xet

Add files using upload-large-folder tool 7 months ago
gemma-3-4b-it-qat-UD-Q2_K_XL.gguf

1.77 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-4b-it-qat-UD-Q3_K_XL.gguf

2.15 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-4b-it-qat-UD-Q4_K_XL.gguf

2.54 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-4b-it-qat-UD-Q5_K_XL.gguf

2.83 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-4b-it-qat-UD-Q6_K_XL.gguf

3.57 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-4b-it-qat-UD-Q8_K_XL.gguf

5.17 GB
xet

Upload folder using huggingface_hub 7 months ago
imatrix_unsloth.dat

3.42 MB
xet

Add files using upload-large-folder tool 7 months ago
mmproj-BF16.gguf

851 MB
xet

Add files using upload-large-folder tool 7 months ago
mmproj-F16.gguf

851 MB
xet

Upload folder using huggingface_hub 7 months ago
mmproj-F32.gguf

1.67 GB
xet

Upload folder using huggingface_hub 7 months ago