Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

976

Base only

Active filters: auto-round

atbender/Qwen3.5-REAP-212B-A17B-W4A16

Text Generation • 30B • Updated Mar 1 • 357 • 24

Intel/GLM-5-int4-mixed-AutoRound

122B • Updated 6 days ago • 136 • 4

YCWTG/Qwen3-Coder-30B-A3B-Instruct-int4-mixed-AutoRound

Text Generation • 6B • Updated Apr 1 • 5

INCModel/DeepSeek-R1-MXFP4-FP8KV-FP8ATTN-AutoRound

13B • Updated Feb 27 • 3

INCModel/DeepSeek-R1-MXFP8-FP8KV-FP8ATTN-AutoRound

2B • Updated Feb 27 • 3

Intel/Qwen3.5-35B-A3B-int4-AutoRound

6B • Updated Mar 13 • 8.77k • 27

Intel/Qwen3.5-397B-A17B-int4-AutoRound

Updated Mar 14 • 59.7k • 15

INCModel/Qwen3-235B-A22B-MXFP8-FP8KV-FP8ATTN-AutoRound

1B • Updated Feb 28 • 2

INCModel/Qwen3-235B-A22B-MXFP4-FP8KV-FP8ATTN-AutoRound

8B • Updated Feb 28 • 1

kaitchup/Qwen3.5-27B-autoround-W4A16

7B • Updated Feb 27 • 123 • 10

atbender/Qwen3-REAP-15B-A3B-W4A16

Text Generation • 0.6B • Updated Mar 1 • 1

atbender/Qwen3-REAP-15B-A3B-W4A16-custom-calib

Text Generation • 0.6B • Updated Mar 1 • 5

kaitchup/Qwen3.5-35B-A3B-autoround-W4A16

6B • Updated Mar 2 • 7 • 3

kaitchup/Qwen3.5-0.8B-autoround-W4A16

0.5B • Updated Mar 3 • 1.31k

kaitchup/Qwen3.5-2B-autoround-W4A16

1B • Updated Mar 3 • 40

kaitchup/Qwen3.5-4B-autoround-W4A16

2B • Updated Mar 3 • 75

kaitchup/Qwen3.5-9B-autoround-W4A16

4B • Updated Mar 3 • 66 • 2

Vishva007/Qwen3.5-0.8B-W4A16-AutoRound

0.4B • Updated Mar 15 • 22

Vishva007/Qwen3.5-9B-W4A16-AutoRound

Image-Text-to-Text • 3B • Updated 18 days ago • 2.43k

Yi30/Qwen2.5-0.5B-Instruct-W4A16

0.2B • Updated Mar 5 • 1

Intel/Devstral-2-123B-Instruct-2512-int4-AutoRound

20B • Updated Mar 5 • 252 • 2

Intel/Qwen3.5-0.8B-int4-AutoRound

0.5B • Updated Mar 5 • 1.21k • 3

Intel/Qwen3.5-2B-int4-AutoRound

1B • Updated Mar 5 • 1.01k • 3

Intel/Qwen3.5-4B-int4-AutoRound

2B • Updated Mar 5 • 4.52k • 6

Intel/Qwen3.5-9B-int4-AutoRound

4B • Updated Mar 5 • 73.6k • 24

Intel/Qwen3.5-27B-int4-AutoRound

7B • Updated Mar 5 • 2.47k • 21

atbender/Qwen3.5-REAP-262B-A17B-W4A16

Text Generation • 40B • Updated Mar 31 • 70 • 3

mhols/Qwen3.5-27B-int4-AutoRound

7B • Updated Mar 9 • 1

Intel/LongCat-Flash-Lite-int4-AutoRound

Text Generation • 38B • Updated Mar 10 • 12 • 2

atbender/Qwen3.5-REAP-20B-A3B-W4A16

Text Generation • 3B • Updated Mar 10 • 103