Qwen3 4B Thinking 2507 Claude Haiku 4.5 High Reasoning Distill - GGUF

This model was finetuned and converted to GGUF format using Unsloth.

Ollama

An Ollama Modelfile is included for easy deployment.

Downloads last month
1,374
GGUF
Model size
4B params
Architecture
qwen3
Hardware compatibility
Log In to view the estimation

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for TeichAI/Qwen3-4B-Thinking-2507-Claude-Haiku-4.5-High-Reasoning-Distill-GGUF

Dataset used to train TeichAI/Qwen3-4B-Thinking-2507-Claude-Haiku-4.5-High-Reasoning-Distill-GGUF