Models

shenzhi-wang/Llama3-8B-Chinese-Chat

Text Generation • 8B • Updated Jul 4, 2024 • 9.68k • • 683

shenzhi-wang/Llama3.1-8B-Chinese-Chat

Text Generation • 8B • Updated Jul 29, 2024 • 24.5k • • 263

v000000/Qwen2.5-Lumen-14B

Text Generation • 15B • Updated Oct 3, 2024 • 1.13k • • 21

OpenBabylon/MamayLM-ORPO-align-lora256

Updated May 9 • 1

nbeerbower/Denker-mistral-nemo-12B

Text Generation • 12B • Updated May 13 • 9 • 4

AmberYifan/Llama-3.1-8B-sft-SPIN-Llama-3.1-70B-Instruct-ORPO

Text Generation • 8B • Updated May 31 • 16 • 1

Rustamshry/Psychology-RLHF

Text Generation • Updated 6 days ago • 28 • 1

Rustamshry/Social-RLHF

Text Generation • Updated 6 days ago • 20 • 1

mradermacher/Denker-mistral-nemo-12B-GGUF

12B • Updated 4 days ago • 257 • 1

mradermacher/Denker-mistral-nemo-12B-i1-GGUF

12B • Updated 4 days ago • 541 • 1

mradermacher/Llama-3.1-8B-sft-SPIN-Llama-3.1-70B-Instruct-ORPO-GGUF

8B • Updated 1 day ago • 2.31k • 1

alvarobartt/Mistral-7B-v0.1-ORPO

Text Generation • 7B • Updated Mar 23, 2024 • 5 • 14

alvarobartt/Mistral-7B-v0.1-ORPO-PEFT

Text Generation • Updated Mar 23, 2024 • 5 • 1

anakin87/gemma-2b-orpo

Text Generation • 3B • Updated Jun 29 • 452 • 28

alvarobartt/mistral-orpo-mix

Text Generation • 7B • Updated Mar 24, 2024 • 4 • 1

bartowski/Mistral-7B-v0.1-ORPO-exl2

Text Generation • Updated Mar 24, 2024

bartowski/Mistral-7B-v0.1-ORPO-GGUF

Text Generation • 7B • Updated Mar 24, 2024 • 85 • 1

alvarobartt/mistral-orpo-mix-b0.1-l2048-pl1792-lr5e-6-inverse-sqrt

Text Generation • 7B • Updated Mar 26, 2024 • 5

alvarobartt/mistral-orpo-mix-b0.05-l1024-pl512-lr5e-7-cosine

Text Generation • 7B • Updated Mar 26, 2024 • 4

alvarobartt/mistral-7b-orpo-alignment-handbook

Text Generation • 7B • Updated Mar 27, 2024 • 6

alvarobartt/mistral-7b-orpo-airoboros-pref-10k

Text Generation • 7B • Updated Mar 28, 2024 • 5

mradermacher/mistral-7b-orpo-capybara-reproduction-GGUF

7B • Updated May 6, 2024 • 478

vain05/stablelm-2-1_6b-orpo-full-v1

Text Generation • 2B • Updated Apr 5, 2024 • 4

anakin87/gemma-2b-orpo-GGUF

3B • Updated Apr 9, 2024 • 2 • 7

vain05/stablelm-2-1_6b-orpo-full-v2

Text Generation • 2B • Updated Apr 6, 2024 • 4

vain05/stablelm-2-1_6b-orpo-full-v3

Text Generation • 2B • Updated Apr 7, 2024 • 5

HuggingFaceH4/zephyr-orpo-141b-A35b-v0.1

Text Generation • 141B • Updated Apr 18, 2024 • 37 • 268

MaziyarPanahi/zephyr-orpo-141b-A35b-v0.1-GGUF

Text Generation • 141B • Updated Apr 12, 2024 • 126 • 29

mlx-community/zephyr-orpo-141b-A35b-v0.1-4bit

22B • Updated Apr 12, 2024 • 7 • 2

wandb/zephyr-orpo-7b-v0.2

Text Generation • 7B • Updated Apr 21, 2024 • 6 • 4