Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

efficient-inference

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

158

Base only

Active filters: efficient-inference

hamadbijarani012/TinyBERT_General_4L_312D_distilled_BERT_base_uncased_SST2_int8

Text Classification • 14.4M • Updated Dec 20, 2025 • 16

Neuro-Lattice/resnet-18-micro-80

Image Classification • 2.37M • Updated Jan 19 • 14

Manifold-Labs/manifold-gfn-xor-128d

Updated Jan 20 • 6

Zhayr1/BitMamba-2-1B

Text Generation • Updated Feb 11 • 64 • 15

Zhayr1/BitMamba-2-0.25B

Text Generation • Updated Feb 11 • 29 • 4

TaoTern/TaoNet-pico-T1

Text Generation • Updated Feb 7 • 9

CesarFavero/rpt-bitnet-2b-pruned

Text Generation • 2B • Updated Feb 8 • 9 • 1

huawei-csl/Qwen3-0.6B-PreSINQ-GGUF

Text Generation • 0.6B • Updated Feb 10 • 16 • 2

huawei-csl/Qwen3-1.7B-PreSINQ-GGUF

Text Generation • 2B • Updated Feb 10 • 34 • 3

huawei-csl/Qwen3-4B-PreSINQ-GGUF

Text Generation • 4B • Updated Feb 10 • 21 • 6

manu02/gemma-3-1b-it-4bit-lora-dpo-aligned-onnx

Updated Feb 14 • 5

RemySkye/MiniMax-M2.5-REAP-50-GGUF

Text Generation • 116B • Updated Mar 1 • 10 • 1

huawei-csl/Qwen3-8B-PreSINQ-GGUF

Text Generation • 8B • Updated Feb 24 • 10 • 2

ay933/BDA-Botanical-Dormancy

rasatavohary/BitMamba-2-0.25B

Text Generation • Updated Mar 23 • 14

rasatavohary/BitMamba-2-1B

Text Generation • Updated Mar 23 • 14

Eunice-Labs/aria-7b-merged

8B • Updated Mar 29 • 3

RemySkye/sn97-distilled-V9-GGUF

Text Generation • 4B • Updated Mar 31 • 30

RemySkye/distil-qwen35-4b-GGUF

Text Generation • 4B • Updated Mar 31 • 68

djdeniro/Qwen3.5-35B-A3B-MXFP4

Image-Text-to-Text • 20B • Updated Apr 10 • 7 • 1

parrishcorcoran/MedusaBitNet-2B-4T

Text Generation • 2B • Updated Apr 13 • 2

pmadinei/Interlace-Qwen3-VL-8B-10pc

Image-Text-to-Text • 745k • Updated Jun 5 • 6

pmadinei/Interlace-Qwen3-VL-8B-15pc

Image-Text-to-Text • 728k • Updated Jun 5 • 17

pmadinei/Interlace-Qwen3-VL-8B-20pc

Image-Text-to-Text • 711k • Updated Jun 5 • 15

pmadinei/Interlace-Qwen3-VL-8B-25pc

Image-Text-to-Text • 694k • Updated Jun 5 • 6

pmadinei/Interlace-Qwen3-VL-4B-10pc

Image-Text-to-Text • 554k • Updated Jun 5 • 5 • 1

pmadinei/Interlace-Qwen3-VL-4B-15pc

Image-Text-to-Text • 543k • Updated Jun 5 • 6

pmadinei/Interlace-Qwen3-VL-4B-20pc

Image-Text-to-Text • 532k • Updated Jun 5 • 6

pmadinei/Interlace-Qwen3-VL-4B-25pc

Image-Text-to-Text • 521k • Updated Jun 5 • 12

open-machine/Llama-3.2-1B-FlashNorm-test

Text Generation • 1B • Updated Apr 18 • 12 • 1