GGUF llama.cpp quantized version of:
- Original model: google/gemma-3-12b-it
- Model creator: Google
- License
Recommended Prompt Format (gemma)
<start_of_turn>model
Provide some context and/or instructions to the model.<end_of_turn>model
<start_of_turn>user
The user’s message goes here<end_of_turn>
<start_of_turn>model
AI message goes here<end_of_turn>model
- Downloads last month
- 19
Hardware compatibility
Log In to add your hardware
4-bit
5-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support