Hugging Face's logo

LoneStriker
/
llama-3-70B-Instruct-abliterated-6.0bpw-h6-exl2

Text Generation
Transformers
Safetensors
llama
conversational
text-generation-inference
Inference Endpoints
6-bit
exl2
Model card Files Community
1
New discussion

did you have to do anything special to quantize this one?

1
#1 opened 6 months ago by gghfez