Hugging Face's logo

noctrex
/
Huihui-Qwen3-VL-4B-Thinking-abliterated-GGUF

Image-Text-to-Text
GGUF
conversational
Model card Files
xet
Community
1

These are quantizations of the model Huihui-Qwen3-VL-4B-Thinking-abliterated

Original model: https://huggingface.co/huihui-ai/Huihui-Qwen3-VL-4B-Thinking-abliterated

Download the latest llama.cpp to use them.

Downloads last month
336
GGUF
Model size
4B params
Architecture
qwen3vl
Hardware compatibility
Log In to add your hardware

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Providers NEW
Image-Text-to-Text
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for noctrex/Huihui-Qwen3-VL-4B-Thinking-abliterated-GGUF

Base model

Qwen/Qwen3-VL-4B-Thinking
Finetuned
huihui-ai/Huihui-Qwen3-VL-4B-Thinking-abliterated
Quantized
(4)
this model

Collections including noctrex/Huihui-Qwen3-VL-4B-Thinking-abliterated-GGUF