Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,428

Base only

Active filters: llama-cpp

ewinregirgojr/MiniCPM5-1B-Agentic-Tooluse-GGUF

Text Generation • 1B • Updated 1 day ago • 6.23k • 33

Nguuma/security-slm-unsloth-1.5b

Text Generation • 2B • Updated May 7 • 1.9k • 42

jica98/qwen3.5-4B-super-coder

Text Generation • 4B • Updated 15 days ago • 31.5k • 37

RavichandranJ/Dolphin3-Cyber-8B-GGUF

Text Generation • 8B • Updated Jun 8 • 48.8k • 37

deadbydawn101/RavenX-CyberAgent-Qwen3.6-35B-A3B-Opus-4.7-OpenMythos-Pentester-BugHunter-RATH-GGUF

Text Generation • 36B • Updated 29 days ago • 24.4k • 94

Abiray/ThinkingCap-Qwen3.6-27B-MTP-Q4_K_M-GGUF

27B • Updated 5 days ago • 590 • 7

BennyDaBall/Krea-2-Engineer-V1-GGUF

Text Generation • 4B • Updated 15 days ago • 6.15k • 27

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 12.6k • 735

prithivMLmods/VibeThinker-3B-GGUF

Text Generation • 3B • Updated 26 days ago • 59.6k • 70

huihui-ai/BaronLLM_Offensive_Security-abliterated-GGUF

Text Generation • 8B • Updated Jun 11, 2025 • 200 • 48

Abiray/Qwen3.6-35B-A3B-Q4_K_M-GGUF

Image-Text-to-Text • 35B • Updated Apr 16 • 5.35k • 21

prism-ml/Ternary-Bonsai-8B-gguf

Text Generation • 8B • Updated Jun 10 • 16.3k • 107

audarai/Audar-ASR-V1-Turbo

Automatic Speech Recognition • 2B • Updated 3 days ago • 1.15k • 3

LordNeel/Agents-A1-GGUF

Text Generation • 35B • Updated 11 days ago • 35.6k • 13

GZGavinZhao/Leanstral-1.5-119B-A6B-GGUF

119B • Updated 6 days ago • 3.18k • 4

Abiray/Qwen3.6-27B-AEON-Ultimate-Uncensored-GGUF

Text Generation • 27B • Updated Apr 27 • 10.2k • 18

spiritbuun/buun-Qwen3.6-chat_template

Updated May 28 • 55

LocalAI-io/privacy-filter-GGUF

Token Classification • 1B • Updated 24 days ago • 882 • 3

hauser458original/arche3.5-codium-0.5B-Q5_K_S-GGUF

Text Generation • 0.5B • Updated 21 days ago • 248 • 2

Abiray/ThinkingCap-Qwen3.6-27B-Q4_K_M-GGUF

Text Generation • 27B • Updated 5 days ago • 235 • 2

PleIAs/Pleias-SLM-RAG

Text Generation • 0.3B • Updated 4 days ago • 70 • 2

kaetemi/Meta-Llama-3.1-8B-Q4_0-GGUF

Text Generation • 8B • Updated Jul 30, 2024 • 75 • 1

hugging-quants/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Sep 25, 2024 • 33k • 35

hugging-quants/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • 3B • Updated Sep 25, 2024 • 1.14k • 53

ggml-org/Qwen2.5-Coder-1.5B-Q8_0-GGUF

Text Generation • 2B • Updated Oct 28, 2024 • 4.64k • 19

HuggingFaceTB/SmolLM2-360M-Instruct-GGUF

0.4B • Updated Oct 31, 2024 • 10.5k • 48

itlwas/Dolphin3.0-Llama3.1-8B-Q4_K_M-GGUF

8B • Updated Jan 5, 2025 • 1.08k • 3

localattention/ShowUI-2B-Q4_K_M-GGUF

2B • Updated Jan 9, 2025 • 366 • 3

mitkox/DeepSeek-R1-Distill-Llama-8B-Q4_K_M-GGUF

8B • Updated Jan 20, 2025 • 338 • 3

matrixportalx/Dolphin3.0-Llama3.1-8B-GGUF

8B • Updated Jan 20, 2025 • 112 • 1