This is quantized version of IlyaGusev/saiga_tlite_8b created using llama.cpp

Downloads last month
36
GGUF
Model size
8.03B params
Architecture
llama

3-bit

4-bit

5-bit

6-bit

8-bit

Inference API
Unable to determine this model's library. Check the docs .