922-SY/xDPO-test-OH-Monika-7b-gguf

Uploaded model

• Developed by: 922CA
• License: apache-2.0
• Finetuned from model : teknium/OpenHermes-7B

This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.

Notes:

• Doesn't perform as well as older models (gets information wrong, too out-of-character, etc. - DPO dataset could be improved), looking into it