Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,382

Full-text search

Active filters: llama.cpp

TeichAI/GLM-4.7-Flash-Claude-Opus-4.5-High-Reasoning-Distill-GGUF

30B • Updated 12 days ago • 102k • 439

LiquidAI/LFM2-24B-A2B-GGUF

Text Generation • 24B • Updated 18 days ago • 20.2k • 101

TeichAI/Qwen3.5-27B-Claude-Opus-4.6-Distill-GGUF

27B • Updated 3 days ago • 7.26k • 17

Ex0bit/Qwen3.5-122B-A10B-PRISM-PRO-GGUF

Image-Text-to-Text • 122B • Updated 5 days ago • 134 • 15

avalon2244/Qwen3.5-4B-Claude-Opus-4.6-Distilled-GGUF

4B • Updated about 21 hours ago • 1.02k • 8

LiquidAI/LFM2.5-1.2B-Thinking-GGUF

Text Generation • 1B • Updated Jan 16 • 49.6k • 66

Ex0bit/Qwen3.5-122B-A10B-PRISM-LITE-GGUF

Image-Text-to-Text • 122B • Updated 6 days ago • 2.62k • 7

Ex0bit/Qwen3.5-PRISM-Dynamic-Quant-GGUF

Text Generation • 0.8B • Updated 4 days ago • 2.29k • 5

jinaai/jina-embeddings-v5-text-small-retrieval

Sentence Similarity • 0.6B • Updated 5 days ago • 144k • 12

Andycurrent/Mistral-Nemo-2407-12B-Thinking-Claude-Gemini-GPT5.2-Uncensored-HERETIC-GGUF

Text Generation • 12B • Updated 3 days ago • 2.25k • 3

marksverdhei/LCO-Embedding-Omni-7B-GGUF

Feature Extraction • 8B • Updated 3 days ago • 648 • 3

LiquidAI/LFM2-350M-GGUF

Text Generation • 0.4B • Updated Dec 5, 2025 • 37.5k • 56

LiquidAI/LFM2.5-1.2B-Instruct-GGUF

Text Generation • 1B • Updated Jan 5 • 52.8k • 139

TeichAI/Devstral-Small-2505-Deepseek-V3.2-Speciale-Distill-GGUF

24B • Updated about 1 month ago • 2.57k • 6

TeichAI/Qwen3-32B-Kimi-K2-Thinking-Distill-GGUF

33B • Updated about 1 month ago • 3.05k • 7

jinaai/jina-embeddings-v5-text-nano-retrieval

Sentence Similarity • 0.2B • Updated 8 days ago • 23.4k • 7

jinaai/jina-embeddings-v5-text-nano-clustering

Feature Extraction • 0.2B • Updated 8 days ago • 16.2k • 5

jinaai/jina-embeddings-v5-text-nano-text-matching

Sentence Similarity • 0.2B • Updated 8 days ago • 17.2k • 4

sokann/Qwen3.5-27B-GGUF-4.165bpw

27B • Updated 7 days ago • 946 • 2

avalon2244/Qwen3.5-4B-Claude-Opus-4.6-Distilled

5B • Updated about 21 hours ago • 295 • 2

marksverdhei/LCO-Embedding-Omni-3B-GGUF

Feature Extraction • 3B • Updated 3 days ago • 626 • 2

nvjob/crack-ru-v2-gguf

12B • Updated Feb 24, 2025 • 447 • 4

LiquidAI/LFM2-700M-GGUF

Text Generation • 0.7B • Updated Dec 5, 2025 • 32.1k • 46

LiquidAI/LFM2-2.6B-GGUF

Text Generation • 3B • Updated Dec 22, 2025 • 38.8k • 45

vito95311/Qwen3-Omni-30B-A3B-Thinking-INT8FP16

Text Generation • 32B • Updated Sep 24, 2025 • 6 • 5

Vikhrmodels/Vistral-24B-Instruct-GGUF

24B • Updated Sep 30, 2025 • 821 • 12

LiquidAI/LFM2-8B-A1B-GGUF

Text Generation • 8B • Updated Dec 5, 2025 • 5.51k • 89

Aadeshisdoingsomething/gemma-3-4b-finetuned

4B • Updated Nov 26, 2025 • 27 • 1

TeichAI/Qwen3-14B-GPT-5.2-High-Reasoning-Distill-GGUF

15B • Updated Dec 23, 2025 • 4.43k • 9

prithivMLmods/Qwen3-VL-8B-Instruct-abliterated-v2-GGUF

Image-Text-to-Text • 8B • Updated Dec 15, 2025 • 12.4k • 18