This contains q4_0, q4_1, q5_0 and q5_1 GGML(v3) and GGUF(v2) quantizations of the model https://huggingface.co/CobraMamba/mamba-gpt-3b-v4
- Downloads last month
- 77
Hardware compatibility
Log In
to view the estimation
4-bit
5-bit