Llama-3-8B ORPOtuned on Intel/orca_dpo_pairs dataset

Brain

Further Testing Needed

  • Developed by: cookinai
  • License: apache-2.0
  • Finetuned from model : unsloth/llama-3-8b-bnb-4bit

This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.

Downloads last month
10
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.

Model tree for cookinai/NeuralLlama-3-ORPO

Finetuned
(2574)
this model
Quantizations
2 models