SamTheDev
/

qwen3-0.6B-oga

Text Generation

onnxruntime-genai

Model card Files Files and versions

My Tests (Tesla P4)

CUDA int4: 1153 MiB, 12 TPS
CUDA fp16: 2179 MiB, 29 TPS
CUDA fp32: dnf

Downloads last month: -; Downloads are not tracked for this model. How to track

Model tree for SamTheDev/qwen3-0.6B-oga

Base model

Qwen/Qwen3-0.6B-Base

Finetuned

Qwen/Qwen3-0.6B

Quantized

(363)

this model

Collection including SamTheDev/qwen3-0.6B-oga

Onnxruntime-Genai Models

onnxruntime-genai models that i've tested on the nvidia tesla p4 • 5 items • Updated 13 days ago