This is quantized version of IlyaGusev/saiga_tlite_8b created using llama.cpp
3-bit
4-bit
5-bit
6-bit
8-bit