Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,253

Base only

Active filters: vllm

doctoridiot/Qwen3.6-27B-abliterated-rMAX-Q5_K_S-GGUF

Image-Text-to-Text • 27B • Updated Apr 24 • 122

RedHatAI/Qwen3.5-9B-quantized.w4a16

Image-Text-to-Text • 9B • Updated 22 days ago • 5.74k • 1

reson8/canary-1b-v2-vllm

Automatic Speech Recognition • 1.0B • Updated Apr 24 • 5

lyf/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive-NVFP4

Image-Text-to-Text • 18B • Updated Apr 25 • 1.2k • 4

Chunity/Qwen3.6-35B-A3B-AutoRound-AWQ-4bit

Image-Text-to-Text • 7B • Updated Apr 24 • 15.6k • 1

MLliu6/Qwen3-VL-2B-Instruct-GPTQ-W4A16

Image-Text-to-Text • 2B • Updated Apr 25 • 7

MLliu6/Qwen3-VL-4B-Instruct-GPTQ-W4A16

Image-Text-to-Text • 4B • Updated Apr 25 • 148

MLliu6/Qwen3-VL-2B-Instruct-SmoothQuant-W8A8-FP8

Image-Text-to-Text • 2B • Updated Apr 25 • 9

MLliu6/Qwen3-VL-4B-Instruct-SmoothQuant-W8A8-FP8

Image-Text-to-Text • 4B • Updated Apr 25 • 4

MLliu6/Qwen3-VL-8B-Instruct-SmoothQuant-W8A8-FP8

Image-Text-to-Text • 9B • Updated Apr 25 • 5

noname002/jina-embeddings-v5-text-nano-retrieval-hieule-3fre

Sentence Similarity • 0.2B • Updated Apr 24 • 132

noname002/jina-embeddings-v5-text-nano-retrieval-hieule-20fre

Sentence Similarity • 0.2B • Updated Apr 24 • 105

BOGDANIMAL/Voxtral-Mini-4B-Realtime-2602

Automatic Speech Recognition • 4B • Updated Apr 24 • 4

BOGDANIMAL/Mistral-Small-3.1-24B-Instruct-2503

24B • Updated Apr 24 • 3

lkk688/Qwen3.6-27B-NVFP4

Image-Text-to-Text • 19B • Updated Apr 26 • 8

mikeytag/gemma-4-E2B-it-NVFP4

Text Generation • 4B • Updated Apr 30 • 118 • 3

TonitoMC/jina-embeddings-v5-text-small-classification-onnx

Text Classification • Updated Apr 25 • 263

prithivMLmods/Qwen3.6-27B-abliterated-rMAX-Q4_K_M-GGUF

Image-Text-to-Text • 27B • Updated Apr 25 • 140 • 1

TonitoMC/jina-embeddings-v5-text-nano-classification-onnx

Text Classification • Updated Apr 25 • 320

zan/Qwen3.6-35B-A3B-DFlash-ja

Text Generation • 0.5B • Updated Apr 25 • 380 • 1

noname002/jinaai-jina-embeddings-v5-text-nano-retrieval-c4vi-200shard-3fre

Sentence Similarity • 0.2B • Updated Apr 25 • 544

DangIT02/qwen3vl-flowchart-to-mermaid-v5

Image-to-Text • 9B • Updated Apr 25 • 22

scrffybear80/Mathstral-7B-v0.1-Q4_K_M-GGUF

7B • Updated Apr 25 • 34

LLM-OS-Models/LFM2-8B-Terminal-SFT-2Epoch-Unsloth

Text Generation • 8B • Updated 25 days ago • 206

LLM-OS-Models/LFM2-2.6B-Terminal-SFT-2Epoch-Unsloth

Text Generation • 3B • Updated 25 days ago • 205

LLM-OS-Models/LFM2.5-1.2B-Terminal-SFT-2Epoch-Unsloth

Text Generation • 1B • Updated 25 days ago • 199

fbs3/gpt-oss-120b

Text Generation • 120B • Updated Apr 25 • 158

YuYu1015/Huihui-Qwen3.6-27B-abliterated-NVFP4

Text Generation • 19B • Updated Apr 26 • 498 • 1

LLM-OS-Models/Qwen3.5-2B-Terminal-SFT-2Epoch-FullFT-SameCount

Text Generation • 2B • Updated 25 days ago • 229

Chiling0/Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-NVFP4

Image-Text-to-Text • Updated Apr 26 • 676