Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

64

Base only

Active filters: npu_4K

amd/CodeLlama-7b-Instruct-hf_rai_1.7.1_npu_4K

Text Generation • Updated Mar 31 • 8

amd/DeepSeek-R1-Distill-Llama-8B_rai_1.7.1_npu_4K

Text Generation • Updated Mar 31 • 5

amd/DeepSeek-R1-Distill-Qwen-1.5B_rai_1.7.1_npu_4K

Text Generation • Updated Mar 31 • 7

amd/DeepSeek-R1-Distill-Qwen-7B_rai_1.7.1_npu_4K

Text Generation • Updated Mar 31 • 6

amd/Llama-2-7b-chat-hf_rai_1.7.1_npu_4K

Text Generation • Updated Mar 31 • 4

amd/Llama-2-7b-hf_rai_1.7.1_npu_4K

Text Generation • Updated Mar 31 • 4

amd/Llama-3.1-8B_rai_1.7.1_npu_4K

Text Generation • Updated Mar 31 • 6

amd/Llama-3.2-1B-Instruct_rai_1.7.1_npu_4K

Text Generation • Updated Mar 31 • 14

amd/Llama-3.2-1B_rai_1.7.1_npu_4K

Text Generation • Updated Mar 31 • 4

amd/Llama-3.2-3B-Instruct_rai_1.7.1_npu_4K

Text Generation • Updated Mar 31 • 5

amd/Llama-3.2-3B_rai_1.7.1_npu_4K

Text Generation • Updated Mar 31 • 7

amd/Meta-Llama-3-8B_rai_1.7.1_npu_4K

Text Generation • Updated Mar 31 • 8

amd/Meta-Llama-3.1-8B-Instruct_rai_1.7.1_npu_4K

Text Generation • Updated Mar 31 • 7

amd/Mistral-7B-Instruct-v0.1_rai_1.7.1_npu_4K

Text Generation • Updated Mar 31 • 9

amd/Mistral-7B-Instruct-v0.2_rai_1.7.1_npu_4K

Text Generation • Updated Mar 31 • 8

amd/Mistral-7B-Instruct-v0.3_rai_1.7.1_npu_4K

Text Generation • Updated Mar 31 • 11

amd/Mistral-7B-v0.3_rai_1.7.1_npu_4K

Text Generation • Updated Mar 31 • 6

amd/Phi-3-mini-128k-instruct_rai_1.7.1_npu_4K

Text Generation • Updated Mar 31 • 4

amd/Phi-3-mini-4k-instruct_rai_1.7.1_npu_4K

Text Generation • Updated Mar 31 • 3

amd/Phi-3.5-mini-instruct_rai_1.7.1_npu_4K

Text Generation • Updated Mar 31 • 6

amd/Phi-4-mini-instruct_rai_1.7.1_npu_4K

Text Generation • Updated Mar 31 • 11

amd/Phi-4-mini-reasoning_rai_1.7.1_npu_4K

Text Generation • Updated Mar 31 • 7

amd/Qwen-2.5_1.5B_Instruct_rai_1.7.1_npu_4K

Text Generation • Updated Mar 31 • 8

amd/Qwen2-1.5B_rai_1.7.1_npu_4K

Text Generation • Updated Mar 31 • 9

amd/Qwen2-7B_rai_1.7.1_npu_4K

Text Generation • Updated Mar 31 • 4

amd/Qwen2.5-0.5B-Instruct_rai_1.7.1_npu_4K

Text Generation • Updated Mar 31 • 12

amd/Qwen2.5-7B-Instruct_rai_1.7.1_npu_4K

Text Generation • Updated Mar 31 • 9

amd/Qwen2.5-Coder-0.5B-Instruct_rai_1.7.1_npu_4K

Text Generation • Updated Mar 31 • 6

amd/Qwen2.5-Coder-1.5B-Instruct_rai_1.7.1_npu_4K

Text Generation • Updated Mar 31 • 10

amd/Qwen2.5-Coder-7B-Instruct_rai_1.7.1_npu_4K

Text Generation • Updated Mar 31 • 5