jpandeinge/DialoGPT-medium-Oshiwambo-Bot-GGUF

Quantized GGUF model files for DialoGPT-medium-Oshiwambo-Bot from jpandeinge

Name	Quant method	Size
dialogpt-medium-oshiwambo-bot.fp16.gguf	fp16	328.09 MB
dialogpt-medium-oshiwambo-bot.q2_k.gguf	q2_k	81.18 MB
dialogpt-medium-oshiwambo-bot.q3_k_m.gguf	q3_k_m	95.45 MB
dialogpt-medium-oshiwambo-bot.q4_k_m.gguf	q4_k_m	110.16 MB
dialogpt-medium-oshiwambo-bot.q5_k_m.gguf	q5_k_m	124.09 MB
dialogpt-medium-oshiwambo-bot.q6_k.gguf	q6_k	135.90 MB
dialogpt-medium-oshiwambo-bot.q8_0.gguf	q8_0	175.36 MB

Original Model Card: