Hugging Face's logo

thesven
/
thesven-OrpoLlama-3-8B-bnb-4bit

Text Generation
Transformers
Safetensors
llama
conversational
text-generation-inference
Inference Endpoints
Model card Files Community

Model Card for Model ID

Model Details

Fine tuned version of Llama3 8B. 4 bit quantized with Bits and Bytes. Fine tuned for 1 epoch for 58 hours on an Nvidia a5000.

Model Description

This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.

  • Developed by: Michael Svendsen
  • Finetuned from model [Llama3-8b]:
Downloads last month
8
Safetensors
Model size
8.03B params
Tensor type
FP16
·
Inference Examples
Text Generation
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Dataset used to train thesven/thesven-OrpoLlama-3-8B-bnb-4bit

Collection including thesven/thesven-OrpoLlama-3-8B-bnb-4bit