Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

43

Base only

Active filters: Distill

stepenZEN/DeepSeek-R1-Distill-Llama-70B-bitsandbytes-4bit

72B • Updated Jan 20, 2025 • 4

prithivMLmods/QwQ-R1-Distill-1.5B-CoT

Text Generation • 2B • Updated Jan 22, 2025 • 17 • 4

mradermacher/QwQ-R1-Distill-1.5B-CoT-GGUF

2B • Updated Jan 24, 2025 • 120 • 1

mradermacher/QwQ-R1-Distill-1.5B-CoT-i1-GGUF

2B • Updated Jan 24, 2025 • 170

stepenZEN/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo

Text Generation • 2B • Updated Jan 24, 2025 • 18 • 3

mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo-GGUF

2B • Updated Jan 28, 2025 • 384 • 5

mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-Abliterated-dpo-i1-GGUF

2B • Updated Jan 28, 2025 • 392

adriey/QwQ-R1-Distill-1.5B-CoT-Q8_0-GGUF

Text Generation • 2B • Updated Jan 29, 2025 • 17

RDson/LIMO-R1-Distill-Qwen-7B

8B • Updated Feb 17, 2025 • 4

mradermacher/LIMO-R1-Distill-Qwen-7B-GGUF

8B • Updated Feb 17, 2025 • 36

prithivMLmods/Delta-Pavonis-Qwen-14B

Text Generation • 15B • Updated Mar 27, 2025 • 4 • 3

mradermacher/Delta-Pavonis-Qwen-14B-GGUF

15B • Updated Jul 11, 2025 • 13 • 1

mradermacher/Delta-Pavonis-Qwen-14B-i1-GGUF

15B • Updated Jul 11, 2025 • 15 • 1

prithivMLmods/Octantis-QwenR1-1.5B-Q8_0-GGUF

Text Generation • 2B • Updated Apr 18, 2025 • 5

ChiKoi7/GPT-5-Distill-Qwen3-4B-Instruct-Heretic

Text Generation • 4B • Updated Dec 12, 2025 • 37 • • 4

ChiKoi7/GPT-5-Distill-Qwen3-4B-Instruct-Heretic-GGUF

4B • Updated Dec 12, 2025 • 535 • 1

mradermacher/GPT-5-Distill-Qwen3-4B-Instruct-Heretic-GGUF

4B • Updated Dec 12, 2025 • 143 • 2

mradermacher/GPT-5-Distill-Qwen3-4B-Instruct-Heretic-i1-GGUF

4B • Updated Dec 12, 2025 • 290 • 1

ChiKoi7/GPT-5-Distill-llama3.2-3B-Instruct-Heretic

3B • Updated Dec 12, 2025 • 34 • 1

ChiKoi7/GPT-5-Distill-llama3.2-3B-Instruct-Heretic-GGUF

3B • Updated Dec 12, 2025 • 199

mradermacher/GPT-5-Distill-llama3.2-3B-Instruct-Heretic-GGUF

3B • Updated Dec 13, 2025 • 281 • 1

mradermacher/GPT-5-Distill-llama3.2-3B-Instruct-Heretic-i1-GGUF

3B • Updated Dec 13, 2025 • 322 • 2

DavidAU/Qwen2.5-7B-Instruct-1M-Thinking-Claude-Gemini-GPT5.2-DISTILL

Text Generation • 8B • Updated Jan 14 • 8 • 6

mradermacher/Qwen2.5-7B-Instruct-1M-Thinking-Claude-Gemini-GPT5.2-DISTILL-GGUF

8B • Updated Jan 14 • 397 • 5

mradermacher/Qwen2.5-7B-Instruct-1M-Thinking-Claude-Gemini-GPT5.2-DISTILL-i1-GGUF

8B • Updated Jan 14 • 720 • 1

alexgusevski/Qwen2.5-7B-Instruct-1M-Thinking-Claude-Gemini-GPT5.2-DISTILL-mlx-2Bit

Text Generation • 0.7B • Updated Jan 15 • 46

alexgusevski/Qwen2.5-7B-Instruct-1M-Thinking-Claude-Gemini-GPT5.2-DISTILL-mlx-3Bit

Text Generation • 1.0B • Updated Jan 15 • 39

alexgusevski/Qwen2.5-7B-Instruct-1M-Thinking-Claude-Gemini-GPT5.2-DISTILL-mlx-4Bit

Text Generation • 1B • Updated Jan 15 • 37

alexgusevski/Qwen2.5-7B-Instruct-1M-Thinking-Claude-Gemini-GPT5.2-DISTILL-mlx-5Bit

Text Generation • 1B • Updated Jan 15 • 47

alexgusevski/Qwen2.5-7B-Instruct-1M-Thinking-Claude-Gemini-GPT5.2-DISTILL-mlx-6Bit

Text Generation • 8B • Updated Jan 15 • 44