Adding `safetensors` variant of this model
#6 opened 10 months ago
by
SFconvertbot
![](https://cdn-avatars.huggingface.co/v1/production/uploads/635fd4cc14657fb8cff2a081/GDkyDwAcuqDBpaOvQgJuq.png)
System Template not used in example
1
#5 opened about 1 year ago
by
SebastianBodza
![](https://cdn-avatars.huggingface.co/v1/production/uploads/6400c075f4ff62c2617023f7/eqm-_73Kwpy0k53uPdLuc.jpeg)
Trying to quantize the model using llama.cpp
#4 opened about 1 year ago
by
Fabian96
Not compatible with text-generation-inference
#3 opened about 1 year ago
by
rredl
AWQ-Variante
4
#2 opened about 1 year ago
by
SebastianBodza
![](https://cdn-avatars.huggingface.co/v1/production/uploads/6400c075f4ff62c2617023f7/eqm-_73Kwpy0k53uPdLuc.jpeg)