Best model for its size, people are not using due to absense of GGUFs.
Can there be official GGUFs for the model? Thats the only reason hardly anyone is using this great of a model
Can there be official GGUFs for the model? Thats the only reason hardly anyone is using this great of a model
You can always use llama.cpp yourself for conversion https://www.geeksforgeeks.org/machine-learning/how-to-convert-a-huggingface-model-to-gguf-file-format/
Or use https://huggingface.co/bartowski/Ling-3.0-tiny-GGUF
I know I can convert. But most users don't convert themselves- nor is it that high quality. Bartowski is also great, but unsloth is just more popular. I feel either unsloth should make the quants or Ling team should publish official ones just to increase publicity. The model deserves it- its literally the best in its size class