Would it be possible to get llama3.3 70b quants if you have the time?
3.1 70b 2bpw was impressively good comparing to iq2_xxs imatrix quants
Definitely. I need to make a few updates to the quantizer and run some tests first, though.
· Sign up or log in to comment