mradermacher/DPOpenHermes-7B-v2-PerfLaser-i1-GGUF
Updated
•
329
Edit Models filters
Intel/orca_dpo_pairs
LDJnr/Capybara
allenai/ultrafeedback_binarized_cleaned
jondurbin/truthy-dpo-v0.1
Open-Orca/SlimOrca
nvidia/HelpSteer
migtissera/Synthia-v1.3
TIGER-Lab/MathInstruct
unalignment/toxic-dpo-v0.1
Muennighoff/natural-instructions
Vezora/Tested-22k-Python-Alpaca
cais/mmlu
codeparrot/apps
facebook/belebele
jondurbin/cinematika-v0.1
lmsys/lmsys-chat-1m
Squish42/bluemoon-fandom-1-1-rp-cleaned
kingbri/PIPPA-shareGPT
teknium/OpenHermes-2.5
HuggingFaceH4/ultrachat_200k
meta-math/MetaMathQA
unalignment/spicy-3.1
argilla/distilabel-capybara-dpo-7k-binarized
Open-Orca/OpenOrca
hkust-nlp/deita-10k-v0
openchat/openchat_sharegpt4_dataset
athirdpath/DPO_Pairs-Roleplay-Alpaca-NSFW
teknium/openhermes
argilla/ultrafeedback-binarized-preferences-cleaned
jondurbin/airoboros-3.2
HuggingFaceH4/ultrafeedback_binarized
MinervaAI/Aesir-Preview
argilla/ultrafeedback-binarized-preferences
Open-Orca/SlimOrca-Dedup
mlabonne/chatml_dpo_pairs
LDJnr/Pure-Dove
wenbopan/Chinese-dpo-pairs
LDJnr/Verified-Camel
argilla/distilabel-math-preference-dpo
glaiveai/glaive-function-calling-v2
HuggingFaceH4/capybara
OpenAssistant/oasst2
cerebras/SlimPajama-627B
cognitivecomputations/WizardLM_evol_instruct_V2_196k_unfiltered_merged_split
MaziyarPanahi/truthy-dpo-v0.1-axolotl
PygmalionAI/PIPPA
allenai/ai2_arc
lemonilia/LimaRP
HuggingFaceH4/no_robots
argilla/distilabel-intel-orca-dpo-pairs
Anthropic/hh-rlhf
NeuralNovel/Neural-Story-v1
PKU-Alignment/PKU-SafeRLHF
chargoddard/rpguild
openai/summarize_from_feedback
pankajmathur/orca_mini_v1_dataset
wikimedia/wikipedia
BAAI/Infinity-Instruct
argilla/OpenHermesPreferences
databricks/databricks-dolly-15k
LDJnr/LessWrong-Amplify-Instruct
Locutusque/Hercules-v3.0
Norquinal/claude_multiround_chat_30k
OpenAssistant/oasst_top1_2023-08-25
Undi95/toxic-dpo-v0.1-NoWarning
codefuse-ai/Evol-instruction-66k
cognitivecomputations/dolphin
fka/awesome-chatgpt-prompts
glaiveai/glaive-code-assistant
imone/OpenOrca_FLAN
kyujinpy/orca_math_dpo
mlabonne/CodeLlama-2-20k
tiedong/goat
Lin-Chen/ShareGPT4V
berkeley-nest/Nectar
ise-uiuc/Magicoder-OSS-Instruct-75K
pankajmathur/WizardLM_Orca
teknium/trismegistus-project
unalignment/toxic-dpo-v0.2
Datasets with no match
mozilla-foundation/common_voice_7_0
mozilla-foundation/common_voice_11_0
cis-lmu/Glot500
allenai/MADLAD-400
marsyas/gtzan
allenai/c4
microsoft/orca-math-word-problems-200k
allenai/nllb
oscar-corpus/OSCAR-2109
bigcode/starcoderdata
m-a-p/CodeFeedback-Filtered-Instruction
garage-bAInd/Open-Platypus
jondurbin/gutenberg-dpo-v0.1
legacy-datasets/wikipedia
cognitivecomputations/dolphin-coder
mozilla-foundation/common_voice_13_0
OpenAssistant/oasst1
cognitivecomputations/samantha-data
tiiuae/falcon-refinedweb
jondurbin/airoboros-2.2.1
facebook/voxpopuli
google/fleurs
PolyAI/minds14
cognitivecomputations/Dolphin-2.9
ise-uiuc/Magicoder-Evol-Instruct-110K
togethercomputer/RedPajama-Data-1T
Locutusque/function-calling-chatml
internlm/Agent-FLAN
mozilla-foundation/common_voice_17_0
yahma/alpaca-cleaned
tatsu-lab/alpaca
HuggingFaceFW/fineweb
uonlp/CulturaX
huggan/smithsonian_butterflies_subset
mozilla-foundation/common_voice_8_0
EleutherAI/pile
camel-ai/math
camel-ai/biology
camel-ai/physics
camel-ai/chemistry
mlabonne/orpo-dpo-mix-40k
nothingiisreal/Reddit-Dirty-And-WritingPrompts
anthracite-org/kalo-opus-instruct-22k-no-refusal
grimulkan/LimaRP-augmented
Gryphe/Sonnet3.5-Charcard-Roleplay
openbmb/UltraFeedback
glaiveai/glaive-code-assistant-v3
Epiculous/Synthstruct-Gens-v1.1-Filtered-n-Cleaned
Gryphe/Sonnet3.5-SlimOrcaDedupCleaned
Epiculous/SynthRP-Gens-v1.1-Filtered-n-Cleaned
HuggingFaceTB/cosmopedia
anon8231489123/ShareGPT_Vicuna_unfiltered
jondurbin/airoboros-3.1
allenai/tulu-v2-sft-mixture
m-a-p/Code-Feedback
mattpscott/airoboros-summarization
metaeval/reclor
HuggingFaceFW/fineweb-edu
b-mc2/sql-create-context
derek-thomas/ScienceQA
nvidia/HelpSteer2
GAIR/lima
jondurbin/airoboros-2.2
mozilla-foundation/common_voice_16_1
flax-sentence-embeddings/stackexchange_xml
embedding-data/sentence-compression
bigcode/commitpackft
tmnam20/VieGLUE
argilla/dpo-mix-7k
relbert/semeval2012_relational_similarity
detection-datasets/coco
abacusai/SystemChat-1.1
embedding-data/PAQ_pairs
embedding-data/WikiAnswers
unicamp-dl/mmarco
allenai/dolma
liuhaotian/LLaVA-Instruct-150K
WhiteRabbitNeo/WRN-Chapter-1
Nopm/Opus_WritingStruct
embedding-data/altlex
embedding-data/simple-wiki
jondurbin/py-dpo-v0.1
bugdaryan/sql-create-context-instruction
WhiteRabbitNeo/WRN-Chapter-2
timdettmers/openassistant-guanaco
allura-org/Celeste-1.x-data-mixture
stanfordnlp/SHP
varun-v-rao/squad
embedding-data/SPECTER
jondurbin/airoboros-gpt4-1.4.1
Active filters:
Intel/orca_dpo_pairs
mradermacher/mistral-7B-forest-dpo-i1-GGUF
Updated
•
623
mradermacher/SOLAR-10.7B-Instruct-Forest-DPO-v1-GGUF
Updated
•
237
mradermacher/SOLAR-10.7B-Instruct-Forest-DPO-v1-i1-GGUF
Updated
•
402
mradermacher/bagel-dpo-34b-v0.2-GGUF
Updated
•
218
mradermacher/nontoxic-bagel-34b-v0.2-GGUF
Updated
•
261
mradermacher/bagel-dpo-34b-v0.2-i1-GGUF
Updated
•
454
mradermacher/nontoxic-bagel-34b-v0.2-i1-GGUF
Updated
•
519
mradermacher/NeuralMaxime-7B-DPO-i1-GGUF
Updated
•
568
mradermacher/Quyen-Pro-Max-v0.1-GGUF
Updated
•
279
mradermacher/DPO_mistral_7b_alpaca_0124_v1-GGUF
Updated
•
274
tensorblock/stablelm-2-1_6b-chat-GGUF
Updated
•
314
mradermacher/Quyen-Pro-Max-v0.1-i1-GGUF
Updated
•
471
mradermacher/Quyen-SE-v0.1-GGUF
Updated
•
232
tensorblock/SOLAR-10.7B-Instruct-v1.0-GGUF
Updated
•
219
mradermacher/Quyen-SE-v0.1-i1-GGUF
Updated
•
452
tensorblock/Faro-Yi-9B-DPO-GGUF
Text Generation
•
Updated
•
233
mav23/SOLAR-10.7B-Instruct-v1.0-GGUF
Updated
•
202
mradermacher/gemma-orchid-7b-dpo-GGUF
Updated
•
276
mradermacher/gemma-orchid-7b-dpo-i1-GGUF
Updated
•
507
tensorblock/Sakura-SOLRCA-Math-Instruct-DPO-v1-GGUF
Text Generation
•
Updated
•
174
tensorblock/stablelm-2-12b-chat-GGUF
Updated
•
284
tensorblock/agiin-13.6B-v0.1-GGUF
Updated
•
210
mradermacher/DPOpenHermes-11B-GGUF
Updated
•
277
mradermacher/neuronovo-7B-v0.3-GGUF
Updated
•
226
mradermacher/DPOpenHermes-11B-i1-GGUF
Updated
•
377
mradermacher/neuronovo-7B-v0.3-i1-GGUF
Updated
•
341
co-gy/Qwen2.5-0.5B-DPO
Updated
•
15
mradermacher/bagel-dpo-7b-v0.1-GGUF
Updated
•
291
mradermacher/bagel-dpo-7b-v0.1-i1-GGUF
Updated
•
353