Hugging Face's logo

LoneStriker
/
Yi-34B-Spicyboros-3.1-6.0bpw-h6-exl2

Text Generation
Transformers
PyTorch
llama
text-generation-inference
Inference Endpoints
Model card Files Community
Yi-34B-Spicyboros-3.1-6.0bpw-h6-exl2

Commit History

Added note on repetition penalty setting
241b801

LoneStriker commited on

Update README.md
b293255

LoneStriker commited on

ExLLaMA V2 quant of Yi-34B-Spicyboros-3.1-6.0bpw-h6-exl2
ef0d0a0

LoneStriker commited on

ExLLaMA V2 quant of Yi-34B-Spicyboros-3.1-6.0bpw-h6-exl2
cfd8755

LoneStriker commited on

initial commit
83018e5

LoneStriker commited on