mlx-community/Qwen3.6-35B-A3B-OptiQ-4bit
Text Generation • 35B • Updated • 9.49k • 72
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
418
Active filters: 8bit
ecastera/eva-mistral-7b-spanish-GGUF
7B • Updated • 51 • 11
mlx-community/Qwen3.5-2B-MLX-8bit
0.9B • Updated • 1.95k • 9
mlx-community/gemma-4-12B-it-qat-OptiQ-4bit
Text Generation • 12B • Updated • 3.04k • 15
mlx-community/MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-OptiQ-4bit
Text Generation • 0.2B • Updated • 1.63k • 6
mlx-community/Qwen3.8-27B-OptiQ-4bit
Image-Text-to-Text • 6B • Updated • 10.9k • 16
MrMofer/Qwen3-27B-OBLITERATED-MLX-8bit
Image-Text-to-Text • 8B • Updated • 371 • 4
ahmedihamdy/Ornith-1.5-35B-A3B-OptiQ-static-5.5bpw
Image-Text-to-Text • 8B • Updated • 158 • 1
ahmedihamdy/Ornith-1.5-9B-vision-OptiQ-static-4.5bpw
Image-Text-to-Text • 2B • Updated • 230 • 3
crumb/gpt-j-6b-finetune-super-glue
Text Generation • Updated • 50
ethzanalytics/gpt-j-6B-8bit-sharded
Text Generation • 6B • Updated • 23 • 7
ethzanalytics/gpt-j-8bit-daily_dialogues
Text Generation • 6B • Updated • 19 • 5
ethzanalytics/gpt-j-8bit-KILT_WoW_10k_steps
Text Generation • Updated • 14
ethzanalytics/dolly-v2-12b-sharded-8bit
Text Generation • Updated • 21 • 4
pszemraj/long-t5-tglobal-xl-16384-book-summary-8bit
Summarization • 3B • Updated • 8
ethzanalytics/open_llama_13b-sharded-8bit
Text Generation • Updated • 7
richardr1126/spider-skeleton-wizard-coder-8bit
Text Generation • Updated • 13 • 1
Trelis/Llama-2-7b-chat-hf-hosted-inference-8bit
Text Generation • 7B • Updated • 14 • 7
Trelis/mpt-7b-instruct-hosted-inference-8bit
Text Generation • Updated • 17
ecastera/eva-mistral-catmacaroni-7b-spanish
Text Generation • 7B • Updated • 11 • 3
ecastera/eva-mistral-turdus-7b-spanish
Text Generation • 7B • Updated • 7
BioMistral/BioMistral-7B-BnB.8
Text Generation • 7B • Updated • 9
alokabhishek/Llama-2-7b-chat-hf-bnb-8bit
Text Generation • 7B • Updated • 10 • 2
alokabhishek/Mistral-7B-Instruct-v0.2-bnb-8bit
Text Generation • 7B • Updated • 15 • 2
alokabhishek/Llama-2-7b-chat-hf-8.0-bpw-exl2
Text Generation • Updated • 6 • 1
alokabhishek/Mistral-7B-Instruct-v0.2-8.0-bpw-exl2
Text Generation • Updated • 5 • 1
alokabhishek/Meta-Llama-3-8B-Instruct-bnb-8bit
Text Generation • 8B • Updated • 8 • 2
alokabhishek/Meta-Llama-3-8B-Instruct-8.0-bpw-exl2
Text Generation • Updated • 5 • 1
legraphista/Yuan2-M32-hf-IMat-GGUF
Text Generation • 40B • Updated • 615 • 3
legraphista/K2-Chat-IMat-GGUF
Text Generation • 65B • Updated • 491 • 5