Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

992

Base only

Active filters: auto-round

Intel/gemma-4-31B-it-int4-AutoRound

6B • Updated May 1 • 70.2k • 49

milkman42069/heretic-int4

55B • Updated Apr 3 • 1

piotr-sikora/Qwopus3.5-9B-W3A16-AutoRound-coding

1B • Updated Apr 3 • 2

ciocan/gemma-4-E4B-it-W4A16

Image-Text-to-Text • 4B • Updated Apr 3 • 188k • 2

sjhorn/flutter-9b-int4

3B • Updated Apr 4 • 1

piotr-sikora/Qwopus3.5-9B-W4A16-AutoRound-coding

3B • Updated Apr 4 • 1

salbeal/Qwopus3.5-27B-v3-int4-AutoRound

Image-Text-to-Text • 7B • Updated Apr 4 • 4

cooperdk/gemma-4-E4B-it-heretic-GPTQ-4bit

Image-Text-to-Text • 8B • Updated Apr 7 • 1.43k

cqkking/gemma-4-26B-A4B-it-int4-mixed-AutoRound

5B • Updated Apr 7 • 191

INC4AI/GLM-5.1-int4-mixed-AutoRound

104B • Updated Apr 9 • 223 • 6

INCModel/NextStep-1.1-W4A16-AutoRound

3B • Updated Apr 10 • 19

Lmbmy/gemma-4-31B-it-int4-AutoRound

6B • Updated Apr 11 • 1

INC4AI/LongCat-Next-int4-AutoRound

Any-to-Any • 44B • Updated Apr 13 • 6 • 2

YuYu1015/Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-int4-AutoRound

Text Generation • 7B • Updated Apr 12 • 128 • 1

YuYu1015/Huihui-Qwen3.5-27B-abliterated-int4-AutoRound

Text Generation • 11B • Updated Apr 12 • 665 • 4

YuYu1015/Huihui-Qwen3.5-27B-Claude-4.6-Opus-abliterated-int4-AutoRound

Text Generation • 11B • Updated Apr 12 • 40 • 1

Vishva007/Qwen3.5-4B-W4A16-AutoRound

1B • Updated Apr 12 • 15

Vishva007/gemma-4-E4B-it-W4A16-AutoRound

Image-Text-to-Text • 4B • Updated 25 days ago • 568

Lasimeri/MiniMax-M2.7-int4-AutoRound

Text Generation • 32B • Updated Apr 13 • 751 • 1

roo5150/gemma-4-26b-autoround

5B • Updated Apr 12 • 2

INCModel/Z-Image-W4A16-AutoRound

Text-to-Image • Updated Apr 13 • 2

INCModel/Z-Image-Turbo-W4A16-AutoRound

Text-to-Image • Updated Apr 13 • 104

YuYu1015/Huihui-Qwopus3.5-27B-v3-abliterated-int4-AutoRound

Text Generation • 11B • Updated Apr 20 • 8 • 2

jorirsan/Qwen3.5-27B-int4-AutoRound

7B • Updated Apr 13 • 2

jorirsan/Qwen3.5-9B-int4

3B • Updated Apr 13 • 3

Vishva007/gemma-4-E2B-it-W4A16-AutoRound

Image-Text-to-Text • 3B • Updated 25 days ago • 1.21k

Immortal66/Qwen3.5-122B-A10B-int4-Quality

18B • Updated Apr 14 • 1

INCModel/Kimi-K2.5-MXFP4-AutoRound

Image-Text-to-Text • 3B • Updated 7 days ago • 18

chrisdemonxxx/Qwen3.5-397B-A17B-heretic-int4-AutoRound-fixed

Text Generation • Updated Apr 15 • 1.09k

dangvansam/chandra-ocr-2-AR-NVFP4

5B • Updated Apr 15 • 69