Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

52

Base only

Active filters: DML

microsoft/Phi-3-mini-4k-instruct-onnx

Text Generation • Updated Dec 10, 2025 • 260 • 146

microsoft/Phi-3-mini-128k-instruct-onnx

Text Generation • Updated May 30, 2025 • 93 • 193

renwoshin/Phi-3-mini-128k-instruct-onnx-tf

Text Generation • Updated Apr 26, 2024 • 18 • 1

Xenova/Phi-3-mini-4k-instruct

Text Generation • Updated Mar 6, 2025 • 555 • 22

Xenova/Phi-3-mini-4k-instruct_fp16

Text Generation • Updated Mar 6, 2025 • 123 • 5

FusionQuill/Phi-3-mini-128k-instruct-onnx

Text Generation • Updated May 17, 2024 • 3

microsoft/Phi-3-small-8k-instruct-onnx-cuda

Text Generation • Updated Jan 23 • 59 • 14

microsoft/Phi-3-medium-4k-instruct-onnx-cpu

Text Generation • Updated Jan 23 • 61 • 7

microsoft/Phi-3-medium-4k-instruct-onnx-cuda

Text Generation • Updated Jan 23 • 58 • 11

microsoft/Phi-3-medium-4k-instruct-onnx-directml

Text Generation • Updated Jan 23 • 60 • 10

microsoft/Phi-3-medium-128k-instruct-onnx-cpu

Text Generation • Updated Jan 23 • 66 • 14

microsoft/Phi-3-medium-128k-instruct-onnx-cuda

Text Generation • Updated Jan 23 • 78 • 24

microsoft/Phi-3-medium-128k-instruct-onnx-directml

Text Generation • Updated Jan 23 • 55 • 6

microsoft/Phi-3-vision-128k-instruct-onnx-cpu

Text Generation • Updated Nov 14, 2024 • 82 • 30

microsoft/Phi-3-vision-128k-instruct-onnx-cuda

Updated Nov 14, 2024 • 59 • 27

microsoft/Phi-3-vision-128k-instruct-onnx-directml

Text Generation • Updated Nov 14, 2024 • 57 • 8

microsoft/mistral-7b-instruct-v0.2-ONNX

Text Generation • Updated May 21, 2024 • 34 • 6

luweigen/Llama-3-8B-Instruct-int4-onnx-directml

Text Generation • Updated Jun 15, 2024 • 4

EmbeddedLLM/llama-2-7b-chat-int4-onnx-directml

Text Generation • Updated Jun 19, 2024 • 3 • 1

EmbeddedLLM/llama-2-13b-chat-int4-onnx-directml

Text Generation • Updated Jun 17, 2024 • 2

EmbeddedLLM/mistral-7b-instruct-v0.3-int4-onnx-directml

Text Generation • Updated Jun 17, 2024 • 4 • 3

EmbeddedLLM/mistral-7b-instruct-v0.3-onnx

Text Generation • Updated Jun 17, 2024 • 2

EmbeddedLLM/gemma-2b-it-onnx

Text Generation • Updated Jun 17, 2024 • 1

EmbeddedLLM/Starling-LM-7b-beta-onnx

Text Generation • Updated Jun 17, 2024

EmbeddedLLM/openchat-3.6-8b-20240522-onnx

Text Generation • Updated Jun 17, 2024 • 1

EmbeddedLLM/Phi-3-small-128k-instruct-onnx

Text Generation • Updated Jun 18, 2024

EmbeddedLLM/Phi-3-vision-128k-instruct-onnx

Text Generation • Updated Jun 20, 2024

EmbeddedLLM/01-ai_Yi-1.5-6B-Chat-onnx

Text Generation • Updated Jun 20, 2024

EmbeddedLLM/gemma-7b-it-onnx

Text Generation • Updated Jun 20, 2024 • 1

EmbeddedLLM/Phi-3-mini-128k-instruct-062024-onnx

Text Generation • Updated Jul 2, 2024