Hugging Face's logo

SicariusSicariiStuff
/
Fiendish_LLAMA_3B_GPTQ-4-bit-128

Text Generation
Transformers
Safetensors
English
llama
conversational
text-generation-inference
4-bit precision
gptq
Model card Files
xet
Community
README.md exists but content is empty.
Downloads last month
-
Safetensors
Model size
0.8B params
Tensor type
I32
路
BF16
路
F16
路
Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 馃檵 Ask for provider support

Model tree for SicariusSicariiStuff/Fiendish_LLAMA_3B_GPTQ-4-bit-128

Base model

meta-llama/Llama-3.2-3B-Instruct
Finetuned
SicariusSicariiStuff/Fiendish_LLAMA_3B
Quantized
(25)
this model