INSAIT-Institute

/

BgGPT-Gemma-2-27B-IT-v1.0-GGUF

like 2

Follow

Institute for Computer Science, Artificial intelligence and Technology 71

Congratulations on a fantastic release!

Would you have some information on performance of the GGUF options? It would be very helpful to know how much of the model quality is retained at different quantisation levels. Even anecdotical evidence would be sufficient.

Thank you in advance,
Krum