YAML Metadata Warning: empty or missing yaml metadata in repo card
Check out the documentation for more information.
GPTQ quantisation of https://huggingface.co/ai-forever/ruGPT-3.5-13B
Small perplexity test: before quantization - 'mean_perplexity': 10.241 after quantization - 'mean_perplexity': 10.379
Data - RussianSuperGlue > DaNetQA/train.jsonl['passage']
As this is a hastily thrown together quant with no prior experience in quants, use https://huggingface.co/TheBloke version if he releases a quant for this model.
- Downloads last month
- 9