Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,631

Base only

Active filters: int8

DreamFast/Qwen3-VL-4b-Heretic-ComfyUI

Image-Text-to-Text • Updated 10 days ago • 40

DreamFast/gemma-3-12b-it-heretic-v2

Text Generation • 12B • Updated 10 days ago • 10.6k • • 72

joeygambino/joyai-echo-ltx23-echoVid-ltxAud-surgical-int8

Text-to-Video • Updated 1 day ago • 520 • 5

88plug/Qwen3.6-35B-A3B-W8A16

Image-Text-to-Text • 35B • Updated 12 days ago • 783 • 3

Winnougan/Comfy-Qwen3-VL-INT8

Updated 29 days ago • 20

Sakujo/FLUX.2-Klein-9B-INT8-ConvRot

Updated 26 days ago • 10

Winnougan/Wan2.2-INT8-Convrot

Updated 26 days ago • 30

supermind/int8_convrot_models

Updated 1 day ago • 15

Winnougan/Qwen-3.5-INT8-Convrot-Comfy

Updated 23 days ago • 16

ariaotp/INT8-ComfyUI

Updated 8 days ago • 2

spybyscript/scyllasband

Text-to-Speech • Updated 2 days ago • 93 • 2

Minachist/Qwen3.6-27B-INT8-Autoround-V2

Image-Text-to-Text • 9B • Updated 1 day ago • 246 • 2

michaelfeil/ct2fast-nllb-200-3.3B

Translation • Updated Jul 20, 2023 • 341 • 15

berryber09/Wan2.2-I2V-14B-INT8-W8A8

Image-to-Video • Updated Feb 18 • 10

EricRollei/HunyuanImage-3.0-Instruct-INT8-v2

Text-to-Image • 83B • Updated Feb 22 • 207 • 2

jamesw767/HunyuanImage-3-Instruct-Distil-INT8

Text-to-Image • 83B • Updated Feb 21 • 38 • 1

aufklarer/DeepFilterNet3-CoreML

Audio-to-Audio • Updated May 28 • 45.6k • 3

shunby/llm-jp-moshi-v1-q8

Updated Mar 24 • 1

RedHatAI/Qwen3.5-9B-quantized.w8a8

Image-Text-to-Text • 9B • Updated Apr 16 • 132k • 2

88plug/Qwen3.6-27B-W8A16

Image-Text-to-Text • 27B • Updated 12 days ago • 6.55k • 3

solphor/Flux2-Dev-INT8-W8A8-Convrot-Model

Text-to-Image • Updated Jun 5 • 10 • 1

ct03/omnivoice-onnx-int8hq

Text-to-Speech • Updated Jun 9 • 34 • 2

groxaxo/Qwen3.6-27B-W8A16-AutoRound

Text Generation • 9B • Updated Jun 16 • 1.61k • 1

CHKH01/BGE-m3-ko-GGUF

Sentence Similarity • 0.6B • Updated Jun 16 • 144 • 1

AEON-7/Qwen3.6-27B-AEON-Ultimate-Uncensored-Multimodal-MLX-8bit

Image-Text-to-Text • 8B • Updated 29 days ago • 2.5k • 5

eldavoo/emma-5

Text Generation • Updated Jun 25 • 79 • 9

Winnougan/Qwen-Image-INT8

Text-to-Image • Updated 27 days ago • 10

John2386/fullgreed

Text-to-Image • Updated 16 days ago • 5.74k • 27

Winnougan/Z-Image-Base-Turbo-INT8-Convrot

Text-to-Image • Updated 25 days ago • 19

LAXMAYDAY/LTX-2.3-22b-dev-int8-tensorwise

Updated 24 days ago • 2