Hugging Face's logo

solidrust
/
Llama-3-DARE-8B-AWQ

Text Generation
Transformers
Safetensors
llama
4-bit precision
AWQ
Inference Endpoints
Merge
mergekit
lazymergekit
conversational
text-generation-inference
awq
Model card Files Community

mlabonne/Llama-3-DARE-8B AWQ

Model Summary

Llama-3-DARE-8B is a merge of the following models using LazyMergekit:

Downloads last month
3
Safetensors
Model size
1.98B params
Tensor type
I32
·
FP16
·
Inference Providers NEW
Text Generation
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API has been turned off for this model.

Model tree for solidrust/Llama-3-DARE-8B-AWQ

Base model

meta-llama/Meta-Llama-3-8B-Instruct
Finetuned
mlabonne/Llama-3-DARE-8B
Quantized
(2)
this model

Collection including solidrust/Llama-3-DARE-8B-AWQ