Hugging Face's logo

macadeliccc
/
SOLAR-10.7b-Instruct-truthy-dpo

Text Generation
Transformers
Safetensors
llama
conversational
Eval Results
text-generation-inference
Inference Endpoints
Model card Files Community
1
SOLAR-10.7b-Instruct-truthy-dpo / README.md
macadeliccc's picture
macadeliccc
Update README.md
b03d05e verified
preview code
|
raw
history blame
546 Bytes
metadata
library_name: transformers
tags: []

SOLAR-10.7b-Instruct-truthy-dpo

orca-bagel

This model is a finetune of macadeliccc/SOLAR-10.7b-Instruct-truthy-dpo

Process

  1. I finetuned upstageai/Solar-10.7b-Instruct-v0.1 with 1 epoch of Intel/orca_dpo_pairs (12.4k samples)
  2. I futher finetuned that model with 3 epochs of jondurbin/truthy-dpo-v0.1 (1.04k samples)
  3. This process is experimental and the base model linked above is more tested at this time.