Edit Models filters

Model Tree

PowerInfer/SmallThinker-3B-Preview

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

19

Full-text search

Active filters: PowerInfer/SmallThinker-3B-Preview

NikolayKozloff/SmallThinker-3B-Preview-Q8_0-GGUF

3B • Updated Dec 30, 2024 • 5 • 1

bartowski/SmallThinker-3B-Preview-GGUF

Text Generation • 3B • Updated Dec 30, 2024 • 1.53k • 31

lace1/SmallThinker-3B-Preview-Q8_0-GGUF

3B • Updated Dec 30, 2024 • 6

adriabama06/SmallThinker-3B-Preview-AWQ

Text Generation • Updated Jan 3, 2025 • 7 • 1

QuantFactory/SmallThinker-3B-Preview-abliterated-GGUF

3B • Updated Jan 2, 2025 • 50 • 4

DevQuasar/PowerInfer.SmallThinker-3B-Preview-GGUF

Text Generation • 3B • Updated Jul 28, 2025 • 45 • 1

itlwas/SmallThinker-3B-Preview-Q4_K_M-GGUF

Text Generation • 3B • Updated Jan 8, 2025 • 7

onnx-community/SmallThinker-3B-Preview-ONNX

Text Generation • Updated Mar 6, 2025 • 9

IntelligentEstate/Tangu-3B-Qwenstar-Q8-GGUF

Text Generation • 3B • Updated Jan 27, 2025 • 8 • 2

mlx-community/smallthinker-3b-preview-q8

Text Generation • Updated Jan 5, 2025 • 11

mlx-community/smallthinker-3b-preview-q4

Text Generation • Updated Jan 5, 2025 • 6

OPEA/SmallThinker-3B-Preview-int4-sym-gguf-q4-0-inc

3B • Updated Jan 14, 2025 • 6 • 1

mlx-community/SmallThinker-3B-Preview-4bit

Text Generation • Updated Jan 7, 2025 • 11 • 1

onnx-community/SmallThinker-3B-Preview-DML-ONNX

Text Generation • Updated Mar 6, 2025 • 5

onnx-community/SmallThinker-3B-Preview-MHA-ONNX

Text Generation • Updated Mar 6, 2025 • 7

PrunaAI/PowerInfer-SmallThinker-3B-Preview-GGUF-smashed

3B • Updated Feb 19, 2025 • 17

mlx-community/SmallThinker-3B-Preview-6bit

Text Generation • Updated Feb 27, 2025 • 7

mku64/SmallThinker-3B-Preview-mlx-4Bit

Text Generation • 0.5B • Updated Mar 28, 2025 • 15

Edge-Quant/SmallThinker-3B-Preview-Q4_K_M-GGUF

Text Generation • 3B • Updated Dec 3, 2025 • 4