Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

996

Base only

Active filters: auto-round

chrisdemonxxx/Qwen3.5-397B-A17B-heretic-int4-AutoRound-fixed

Text Generation • Updated Apr 15 • 1.1k

dangvansam/chandra-ocr-2-AR-NVFP4

5B • Updated Apr 15 • 69

MJPansa/MiniMax-M2.7-REAP-172B-A10B-AutoRound-W4A16

Text Generation • 24B • Updated Apr 15 • 1.58k • 9

bochu/XORTRON.CriminalComputing.2026.27B.Instruct.NEXT-autoround

7B • Updated Apr 17 • 106

0xSero/Trinity-337B-W4A16

Text Generation • 46B • Updated 5 days ago • 15

sphaela/gemma-4-E2B-it-AutoRound-GGUF

5B • Updated Apr 24 • 465

sphaela/gemma-4-E4B-it-AutoRound-GGUF

8B • Updated Apr 24 • 484 • 1

sphaela/gemma-4-31B-it-AutoRound-GGUF

31B • Updated Apr 24 • 539 • 1

sphaela/gemma-4-26B-A4B-it-AutoRound-GGUF

25B • Updated Apr 24 • 814 • 6

MuVeraAI/glm-5-381-reap-w3a16

Text Generation • 41B • Updated Apr 17 • 8

sphaela/Qwen3.6-35B-A3B-AutoRound-GGUF

35B • Updated Apr 24 • 2.23k • 11

Minachist/Qwen3.6-35B-A3B-INT8-AutoRound

Image-Text-to-Text • 11B • Updated 22 days ago • 4.67k • 4

0xSero/GLM-5.1-555B-NVFP4

Text Generation • 3B • Updated 5 days ago • 106

genevera/Qwen3.6-35B-A3B-Abliterated-Heretic-AWQ-4bit

Text Generation • 36B • Updated Apr 26 • 9.59k • 8

atbender/Qwen3.6-VL-REAP-26B-A3B-W4A16

Text Generation • 1B • Updated Apr 19 • 5.87k • 4

YuYu1015/Huihui-Qwen3.6-35B-A3B-abliterated-int4-AutoRound

Text Generation • 7B • Updated Apr 26 • 14.2k • 3

0xSero/DeepSeek-V3.2-508B-NVFP4

Text Generation • 2B • Updated 5 days ago • 78

andysalerno/Qwen3.6-27B-W4A16-g32-optrtn-gptq

16B • Updated Apr 25 • 2.32k

INCModel/Z-Image-tiny-for-testing-W4A16-AutoRound

Text-to-Image • Updated Apr 23 • 16

acyildirimer/Qwen3.6-27B-int4-AutoRound

3B • Updated 6 days ago • 2.5k

lvkaokao/Qwen3-0.6B-autoround-W4A16

0.2B • Updated 26 days ago • 105

INC4AI/Qwen3-0.6B-autoround-W4A16

0.2B • Updated Apr 27 • 6

hell0ks/Qwen3.6-27B-heretic-ara-int4-AutoRound

Image-Text-to-Text • 6B • Updated Apr 24 • 147 • 1

lvkaokao/Qwen3-1.7B-autoround-W4A16

0.5B • Updated 26 days ago • 21

lvkaokao/Qwen3-4B-Instruct-2507-autoround-W4A16

0.9B • Updated 18 days ago • 19

lvkaokao/Qwen3.5-0.8B-autoround-W4A16

0.4B • Updated Apr 24 • 3

INCModel/Qwen3-30B-A3B-Instruct-2507-MXFP8-FP8KV-AR

0.6B • Updated Apr 27 • 2

INCModel/Qwen3-30B-A3B-Instruct-2507-MXFP8-FP8ATTN-AR

0.6B • Updated Apr 27 • 1

lvkaokao/Qwen3-32B-autoround-W4A16

6B • Updated 26 days ago • 20

abhinand/Qwen3.6-35B-A3B-int4-AutoRound

Image-Text-to-Text • 6B • Updated Apr 27 • 13.8k