Hugging Face's logo

noctrex
/
Huihui-Qwen3-VL-30B-A3B-Instruct-abliterated-GGUF

Image-Text-to-Text
GGUF
imatrix
conversational
Model card Files
xet
Community
2

These are quantizations of the model Huihui-Qwen3-VL-30B-A3B-Instruct-abliterated

The imatrix from unsloth has been used for these.

Original model: https://huggingface.co/huihui-ai/Huihui-Qwen3-VL-30B-A3B-Instruct-abliterated

Download the latest llama.cpp to use them.

Try to use the best quality you can run.
For the mmproj, try to use the F32 version as it will produce the best results.
F32 > BF16 > F16.

Downloads last month
19,484
GGUF
Model size
31B params
Architecture
qwen3vlmoe
Hardware compatibility
Log In to view the estimation

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW
Image-Text-to-Text
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for noctrex/Huihui-Qwen3-VL-30B-A3B-Instruct-abliterated-GGUF

Base model

Qwen/Qwen3-VL-30B-A3B-Instruct
Quantized
huihui-ai/Huihui-Qwen3-VL-30B-A3B-Instruct-abliterated
Quantized
(3)
this model

Collections including noctrex/Huihui-Qwen3-VL-30B-A3B-Instruct-abliterated-GGUF