Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

542

Base only

Active filters: efficient

roylin1003/royal-ZhTW-ID-q4_k_m

Text Generation • 8B • Updated Jun 3, 2025 • 25 • 1

roylin1003/royal-zhTW-ID-q3_k_s.gguf

Text Generation • 8B • Updated Jun 3, 2025 • 19

roylin1003/royal-zhTW-ID-q2_k.gguf

Text Generation • 8B • Updated Jun 3, 2025 • 21

vlad-m-dev/mobilenetv2_doc_photo_quant

Image Classification • Updated Jun 15, 2025 • 1

gincioks/cerberus-distilbert-base-un-v1.0

Text Classification • 67M • Updated Jun 15, 2025 • 12

vlad-m-dev/mobilenet_v3_small_onnx_photo_doc

Image Classification • Updated Jun 15, 2025 • 2

gincioks/cerberus-modernbert-base-v1.0

Text Classification • 0.1B • Updated Jun 15, 2025 • 7

vlad-m-dev/distiluse-base-multilingual-v2-merged-onnx

Feature Extraction • Updated Oct 29, 2025 • 1

onnx-community/distiluse-base-multilingual-v2-merged-onnx

Feature Extraction • Updated Jun 26, 2025 • 1

HackNetAyush/smollm2-135M-instruct-gguf-q8

Text Generation • 0.1B • Updated Jul 20, 2025 • 133 • 3

mradermacher/aquif-3-micro-GGUF

0.4B • Updated Sep 7, 2025 • 47

mradermacher/aquif-3-micro-i1-GGUF

0.4B • Updated Dec 25, 2025 • 151

AmanPriyanshu/gpt-oss-4.2b-specialized-all-pruned-moe-only-4-experts

Text Generation • 4B • Updated Aug 13, 2025 • 13 • 8

AmanPriyanshu/gpt-oss-4.8b-specialized-all-pruned-moe-only-5-experts

Text Generation • 5B • Updated Aug 13, 2025 • 4 • 2

AmanPriyanshu/gpt-oss-5.4b-specialized-all-pruned-moe-only-6-experts

Text Generation • 5B • Updated Aug 13, 2025 • 32 • 1

AmanPriyanshu/gpt-oss-6.0b-specialized-all-pruned-moe-only-7-experts

Text Generation • 6B • Updated Aug 13, 2025 • 20 • 26

AmanPriyanshu/gpt-oss-6.6b-specialized-all-pruned-moe-only-8-experts

Text Generation • 7B • Updated Aug 13, 2025 • 11 • 2

AmanPriyanshu/gpt-oss-7.2b-specialized-all-pruned-moe-only-9-experts

Text Generation • 7B • Updated Aug 13, 2025 • 7 • 1

AmanPriyanshu/gpt-oss-7.8b-specialized-all-pruned-moe-only-10-experts

Text Generation • 8B • Updated Aug 13, 2025 • 7 • 1

AmanPriyanshu/gpt-oss-8.4b-specialized-all-pruned-moe-only-11-experts

Text Generation • 8B • Updated Aug 13, 2025 • 12 • 2

AmanPriyanshu/gpt-oss-9.0b-specialized-all-pruned-moe-only-12-experts

Text Generation • 9B • Updated Aug 13, 2025 • 11 • 2

AmanPriyanshu/gpt-oss-9.6b-specialized-all-pruned-moe-only-13-experts

Text Generation • 10B • Updated Aug 13, 2025 • 7 • 1

AmanPriyanshu/gpt-oss-10.2b-specialized-all-pruned-moe-only-14-experts

Text Generation • 10B • Updated Aug 13, 2025 • 10 • 2

AmanPriyanshu/gpt-oss-10.8b-specialized-all-pruned-moe-only-15-experts

Text Generation • 11B • Updated Aug 13, 2025 • 8 • 3

AmanPriyanshu/gpt-oss-11.4b-specialized-all-pruned-moe-only-16-experts

Text Generation • 11B • Updated Aug 13, 2025 • 11 • 3

AmanPriyanshu/gpt-oss-12.0b-specialized-all-pruned-moe-only-17-experts

Text Generation • 12B • Updated Aug 13, 2025 • 7 • 1

AmanPriyanshu/gpt-oss-12.6b-specialized-all-pruned-moe-only-18-experts

Text Generation • 13B • Updated Aug 13, 2025 • 7 • 1

AmanPriyanshu/gpt-oss-13.1b-specialized-all-pruned-moe-only-19-experts

Text Generation • 13B • Updated Aug 13, 2025 • 12 • 2

AmanPriyanshu/gpt-oss-13.7b-specialized-all-pruned-moe-only-20-experts

Text Generation • 14B • Updated Aug 13, 2025 • 9 • 2

AmanPriyanshu/gpt-oss-14.3b-specialized-all-pruned-moe-only-21-experts

Text Generation • 14B • Updated Aug 13, 2025 • 6 • 1