Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,000

Base only

Active filters: auto-round

lvkaokao/Llama-3.1-8B-Instruct-autoround-W4A16

2B • Updated Apr 28 • 4

WebScraper991923/Test

6B • Updated Apr 28 • 8

lvkaokao/Qwen3.5-9B-autoround-W4A16

3B • Updated 27 days ago • 17

lvkaokao/Qwen3.5-2B-autoround-W4A16

1B • Updated 28 days ago • 24

lvkaokao/Qwen3.5-9B-GLM5.1-Distill-v1-autoround-W4A16

3B • Updated Apr 29 • 110

Minachist/Qwen3.6-27B-Mixed-AutoRound

Image-Text-to-Text • 11B • Updated 29 days ago • 924 • 2

lvkaokao/gemma-4-E4B-it-autoround-W4A16

5B • Updated Apr 29 • 13

lvkaokao/Qwen3.5-27B-autoround-W4A16

7B • Updated Apr 29 • 3

lvkaokao/Gemopus-4-E4B-it-autoround-W4A16

5B • Updated Apr 29 • 3

lvkaokao/Qwopus3.5-9B-v3-autoround-W4A16

3B • Updated Apr 29 • 4

lvkaokao/Gemma4-GarnetV2-31B-autoround-W4A16

6B • Updated Apr 29 • 352

lvkaokao/bart-large-cnn-autoround-W4A16

79.7M • Updated Apr 30 • 5

groxaxo/octen-embedding-4b-w4a16

Text Generation • 0.9B • Updated Apr 30 • 142 • 1

groxaxo/octen-embedding-8b-w4a16

Text Generation • 1B • Updated Apr 30 • 226 • 1

lvkaokao/kobart-summary-v3-autoround-W4A16

31.5M • Updated Apr 30 • 2

lvkaokao/t5-small-autoround-W4A16

22.4M • Updated Apr 30 • 3

lvkaokao/SciThinker-30B-autoround-W4A16

5B • Updated Apr 30 • 3

lvkaokao/Chocolatine-2-4B-Instruct-DPO-v2.1-autoround-W4A16

0.9B • Updated Apr 30 • 6

lvkaokao/Sugoi-14B-Ultra-HF-autoround-W4A16

3B • Updated Apr 30 • 5

lvkaokao/GLM-OCR-autoround-W4A16

0.7B • Updated Apr 30 • 32

lvkaokao/roberta-large-squad2-autoround-W4A16

93.8M • Updated Apr 30 • 7

YuYu1015/Huihui-Qwen3.6-27B-abliterated-int4-AutoRound

Text Generation • 6B • Updated May 3 • 2.91k • 1

Intel/Qwen3.6-35B-A3B-int4-mixed-AutoRound

6B • Updated May 1 • 42.9k • 6

callgg/minimax-m2.7

24B • Updated May 1 • 70 • 1

plezan/Mistral-Medium-3.5-128B-W4A16

Image-Text-to-Text • 22B • Updated May 4 • 1.36k • 3

CoreWorxLab/Qwen3.6-27B-Claude-Opus-Reasoning-Distill-v2-int4-AutoRound

Text Generation • 6B • Updated May 3 • 1.15k • 14

YuYu1015/Huihui-Qwen3.6-35B-A3B-Claude-4.7-Opus-abliterated-int4-AutoRound

Text Generation • 7B • Updated May 3 • 1.43k • 1

wasifb/Carnice_V2_27B_INT4_BF16MTP

Text Generation • 7B • Updated May 4 • 1

gratex/Mistral-Small-3.2-24B-Instruct-2506-W4A16-AutoRound

Image-Text-to-Text • 4B • Updated 28 days ago • 408

seraphimserapis/gemma-4-31B-it-NVFP4

Image-Text-to-Text • 2B • Updated about 1 month ago • 15