GSQ: Highly-Accurate Low-Precision Scalar Quantization for LLMs via Gumbel-Softmax Sampling
Paper • 2604.18556 • Published • 20
GSQ
GSQ: Highly-Accurate Low-Precision Scalar Quantization for LLMs via Gumbel-Softmax Sampling, https://huggingface.co/papers/2604.18556
-
-
ISTA-DASLab/Kimi-K2.6-2Bit-GSQ
Image-Text-to-Text • 84B • Updated • 272 • 6 -
ISTA-DASLab/Kimi-K2.5-2Bit-GSQ
Image-Text-to-Text • 84B • Updated • 482 • 1 -
ISTA-DASLab/Llama-3.1-70B-Instruct-2Bit-GSQ
Text Generation • 7B • Updated • 132 • 2 -
ISTA-DASLab/Llama-3.1-70B-Instruct-3Bit-GSQ
Text Generation • 9B • Updated • 82 • 1 -
ISTA-DASLab/Qwen3.6-35B-A3B-2Bit-GSQ
Image-Text-to-Text • 36B • Updated • 2.1k • 20 -
ISTA-DASLab/Qwen3-4B-GGUF-GSQ
Text Generation • 4B • Updated • 278 • 1 -
ISTA-DASLab/Qwen3-8B-GGUF-GSQ
Text Generation • 8B • Updated • 1.4k • 4 -
ISTA-DASLab/Qwen3.5-4B-GGUF-GSQ
Text Generation • 4B • Updated • 2.55k • 9 -
ISTA-DASLab/Qwen3.8-27B-3Bit-GSQ
Image-Text-to-Text • 27B • Updated • 8.03k • 20