Official GGUF models uploaded
#1
by
Shaltiel
- opened
Thanks for creating GGUF versions of the models! I noticed a small issue with the conversion - the chat template wasn't included in the model so LMStudio didn't work with them well.
We uploaded GGUF conversions of the models here with imatrix-quantizations and the correct chat template:
https://huggingface.co/dicta-il/DictaLM-3.0-24B-Thinking-GGUF
https://huggingface.co/dicta-il/DictaLM-3.0-1.7B-Thinking-GGUF
Thank you for releasing official gguf.
I was excited to test the gguf conversion, so I couldn't wait.
Please share the best LM studio configurations so others can reuse them.
This comment has been hidden (marked as Off-Topic)
This comment has been hidden (marked as Off-Topic)