Mungert
/

Holo2-30B-A3B-GGUF

Image-Text-to-Text

Model card Files Files and versions

Holo2-30B-A3B-GGUF

498 GB

1 contributor

History: 34 commits

Mungert's picture

Upload Holo2-30B-A3B-f16.mmproj with huggingface_hub

9b4e00d verified 5 days ago

bf16
Upload bf16/Holo2-30B-A3B-bf16-00002-of-00002.gguf with huggingface_hub 5 days ago
.gitattributes

3.53 kB

Upload Holo2-30B-A3B-f16.mmproj with huggingface_hub 5 days ago
Holo2-30B-A3B-bf16.mmproj

1.09 GB
xet

Upload Holo2-30B-A3B-bf16.mmproj with huggingface_hub 5 days ago
Holo2-30B-A3B-f16.mmproj

1.08 GB
xet

Upload Holo2-30B-A3B-f16.mmproj with huggingface_hub 5 days ago
Holo2-30B-A3B-f16_q8_0.gguf

38.7 GB
xet

Upload Holo2-30B-A3B-f16_q8_0.gguf with huggingface_hub 5 days ago
Holo2-30B-A3B-f32.mmproj

2.15 GB
xet

Upload Holo2-30B-A3B-f32.mmproj with huggingface_hub 5 days ago
Holo2-30B-A3B-imatrix.gguf

122 MB
xet

Upload Holo2-30B-A3B-imatrix.gguf with huggingface_hub 5 days ago
Holo2-30B-A3B-iq1_m.gguf

10 GB
xet

Upload Holo2-30B-A3B-iq1_m.gguf with huggingface_hub 5 days ago
Holo2-30B-A3B-iq1_s.gguf

9.09 GB
xet

Upload Holo2-30B-A3B-iq1_s.gguf with huggingface_hub 5 days ago
Holo2-30B-A3B-iq2_m.gguf

11.5 GB
xet

Upload Holo2-30B-A3B-iq2_m.gguf with huggingface_hub 5 days ago
Holo2-30B-A3B-iq2_s.gguf

11 GB
xet

Upload Holo2-30B-A3B-iq2_s.gguf with huggingface_hub 5 days ago
Holo2-30B-A3B-iq2_xs.gguf

11 GB
xet

Upload Holo2-30B-A3B-iq2_xs.gguf with huggingface_hub 5 days ago
Holo2-30B-A3B-iq2_xxs.gguf

9.84 GB
xet

Upload Holo2-30B-A3B-iq2_xxs.gguf with huggingface_hub 5 days ago
Holo2-30B-A3B-iq3_m.gguf

15.4 GB
xet

Upload Holo2-30B-A3B-iq3_m.gguf with huggingface_hub 5 days ago
Holo2-30B-A3B-iq3_xs.gguf

13.8 GB
xet

Upload Holo2-30B-A3B-iq3_xs.gguf with huggingface_hub 5 days ago
Holo2-30B-A3B-iq3_xxs.gguf

13.7 GB
xet

Upload Holo2-30B-A3B-iq3_xxs.gguf with huggingface_hub 5 days ago
Holo2-30B-A3B-iq4_nl.gguf

17.2 GB
xet

Upload Holo2-30B-A3B-iq4_nl.gguf with huggingface_hub 5 days ago
Holo2-30B-A3B-iq4_xs.gguf

16.5 GB
xet

Upload Holo2-30B-A3B-iq4_xs.gguf with huggingface_hub 5 days ago
Holo2-30B-A3B-q2_k_m.gguf

12 GB
xet

Upload Holo2-30B-A3B-q2_k_m.gguf with huggingface_hub 5 days ago
Holo2-30B-A3B-q2_k_s.gguf

11.9 GB
xet

Upload Holo2-30B-A3B-q2_k_s.gguf with huggingface_hub 5 days ago
Holo2-30B-A3B-q3_k_m.gguf

15.8 GB
xet

Upload Holo2-30B-A3B-q3_k_m.gguf with huggingface_hub 5 days ago
Holo2-30B-A3B-q3_k_s.gguf

15.8 GB
xet

Upload Holo2-30B-A3B-q3_k_s.gguf with huggingface_hub 5 days ago
Holo2-30B-A3B-q4_0.gguf

17.5 GB
xet

Upload Holo2-30B-A3B-q4_0.gguf with huggingface_hub 5 days ago
Holo2-30B-A3B-q4_1.gguf

19.2 GB
xet

Upload Holo2-30B-A3B-q4_1.gguf with huggingface_hub 5 days ago
Holo2-30B-A3B-q4_k_m.gguf

19 GB
xet

Upload Holo2-30B-A3B-q4_k_m.gguf with huggingface_hub 5 days ago
Holo2-30B-A3B-q4_k_s.gguf

18.2 GB
xet

Upload Holo2-30B-A3B-q4_k_s.gguf with huggingface_hub 5 days ago
Holo2-30B-A3B-q5_0.gguf

21.3 GB
xet

Upload Holo2-30B-A3B-q5_0.gguf with huggingface_hub 5 days ago
Holo2-30B-A3B-q5_1.gguf

23.1 GB
xet

Upload Holo2-30B-A3B-q5_1.gguf with huggingface_hub 5 days ago
Holo2-30B-A3B-q5_k_m.gguf

22.5 GB
xet

Upload Holo2-30B-A3B-q5_k_m.gguf with huggingface_hub 5 days ago
Holo2-30B-A3B-q6_k_m.gguf

25.2 GB
xet

Upload Holo2-30B-A3B-q6_k_m.gguf with huggingface_hub 5 days ago
Holo2-30B-A3B-q8_0.gguf

32.5 GB
xet

Upload Holo2-30B-A3B-q8_0.gguf with huggingface_hub 5 days ago
Holo2-30B-A3B-q8_0.mmproj

712 MB
xet

Upload Holo2-30B-A3B-q8_0.mmproj with huggingface_hub 5 days ago
README.md

12.1 kB

Upload README.md with huggingface_hub 5 days ago