Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

996

Base only

Active filters: auto-round

atbender/Qwen3.5-REAP-262B-A17B-W4A16

Text Generation • 40B • Updated Mar 31 • 69 • 3

mhols/Qwen3.5-27B-int4-AutoRound

7B • Updated Mar 9 • 1

Intel/LongCat-Flash-Lite-int4-AutoRound

Text Generation • 38B • Updated Mar 10 • 16 • 2

atbender/Qwen3.5-REAP-20B-A3B-W4A16

Text Generation • 3B • Updated Mar 10 • 102

Intel/Step-3.5-Flash-int4-mixed-AutoRound

Text Generation • 44B • Updated Apr 14 • 171 • 9

np-deploys/Qwen3-VL-8B-Instruct-W4A16-AutoRound-GPTQ

Image-Text-to-Text • 2B • Updated Mar 13 • 4

happypatrick/Qwen3.5-122B-A10B-heretic-int4-AutoRound

Image-Text-to-Text • 19B • Updated Mar 15 • 2.08k • 10

Intel/MiroThinker-1.7-mini-int4-AutoRound

Text Generation • 5B • Updated Mar 16 • 160 • 2

Intel/MiroThinker-1.7-int4-AutoRound

Text Generation • 33B • Updated Mar 17 • 158 • 5

i-morxi/Huihui-Qwen3.5-35B-A3B-abliterated-autoround

6B • Updated Mar 18 • 2

Feng613/SleepVLM-3B-W4A16

Image-Text-to-Text • 1B • Updated Mar 17 • 7

groxaxo/Qwen3.5-27B-heretic-v2-autoround-w4a16

Image-Text-to-Text • 3B • Updated Mar 29 • 8 • 1

groxaxo/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-heretic-v2-AutoRound-W4A16

Image-Text-to-Text • 3B • Updated Mar 17 • 8 • 2

Intel/Qwen2.5-Omni-7B-int4-AutoRound

5B • Updated Apr 17 • 376 • 2

YCWTG/Qwen3.5-35B-A3B-Instruct-int4-mixed-AutoRound

Image-Text-to-Text • 7B • Updated Apr 1 • 18 • 3

Intel/Qwen3-Omni-30B-A3B-Instruct-int4-AutoRound

9B • Updated Apr 16 • 6.66k • 4

agustim/ALIA-40b-GPTQ-INT4

4B • Updated Mar 19 • 1

groxaxo/Qwen3.5-27B-heretic-v3-autoround-w4a16

3B • Updated Mar 19 • 6

0xSero/Nemotron-3-Super-92B-W4A16

Text Generation • 6B • Updated 6 days ago • 174 • 2

0xSero/Nemotron-3-Super-64B-W4A16

Text Generation • 6B • Updated 6 days ago • 182 • 3

agustim/ALIA-40b-GPTQ-INT4_3b

4B • Updated Mar 20 • 1

agustim/ALIA-40b-AutoRound-INT4_3b

4B • Updated Mar 20 • 1

magicshim/Huihui-Qwen3-Coder-Next-abliterated-int4-AutoRound

Text Generation • 12B • Updated Mar 25 • 124 • 1

happypatrick/Qwen3.5-397B-A17B-heretic-int4-AutoRound

Text Generation • Updated Mar 26 • 3.75k • 4

groxaxo/Qwen3.5-9B-Abliterated-Claude-4.6-Opus-gptq-w4a16

3B • Updated Apr 10 • 147 • 1

CCSSNE/happypatrick-Qwen3.5-397B-A17B-heretic-int4-AutoRound

Text Generation • Updated Mar 29 • 228

sch0tten/Qwen3.5-27B-Uncensored-AWQ

10B • Updated Mar 30 • 585 • 2

Intel/BAGEL-7B-MoT-int4-AutoRound

10B • Updated 9 days ago • 28

salbeal/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-int4-AutoRound

Image-Text-to-Text • 7B • Updated Apr 4 • 56 • 2

Lorbus/Qwopus3.5-27B-v3-int4-autoround

6B • Updated Apr 3 • 283 • 4