PreferenceShareGPT

PJMixers 's Collections

updated Aug 8

Preference datasets converted to use a custom "ShareGPT-like" format. https://gist.github.com/xzuyn/87097972ab2323ced81e4d7b41c47a45

Upvote

PJMixers/argilla_Capybara-Preferences-PreferenceShareGPT

Viewer • Updated May 30 • 15.4k • 43
PJMixers/argilla_Capybara-Preferences-Filtered-PreferenceShareGPT

Viewer • Updated May 30 • 14.8k • 45 • 1
PJMixers/argilla_ultrafeedback-binarized-preferences-cleaned-PreferenceShareGPT

Viewer • Updated May 30 • 60.9k • 42 • 1
PJMixers/argilla_ultrafeedback-multi-binarized-preferences-cleaned-PreferenceShareGPT

Viewer • Updated May 30 • 158k • 38 • 1
PJMixers/argilla_ultrafeedback-multi-binarized-quality-preferences-cleaned-PreferenceShareGPT

Viewer • Updated May 30 • 155k • 44 • 1
PJMixers/argilla_distilabel-math-preference-dpo-PreferenceShareGPT

Viewer • Updated May 30 • 2.42k • 40
PJMixers/Intel_orca_dpo_pairs-PreferenceShareGPT

Viewer • Updated May 30 • 11.9k • 47 • 1
PJMixers/unalignment_toxic-dpo-v0.2-PreferenceShareGPT

Updated May 30 • 36
PJMixers/Doctor-Shotgun_theory-of-mind-dpo-PreferenceShareGPT

Viewer • Updated May 30 • 539 • 43 • 1
PJMixers/antiven0m_physical-reasoning-dpo-PreferenceShareGPT

Viewer • Updated May 30 • 899 • 42
PJMixers/tatsu-lab_alpaca_farm_human_preference-PreferenceShareGPT

Viewer • Updated May 30 • 3.8k • 45 • 2
PJMixers/antiven0m_catboros-3.2-dpo-PreferenceShareGPT

Viewer • Updated May 30 • 1.42k • 43 • 1
PJMixers/M4-ai_prm_dpo_pairs_cleaned-PreferenceShareGPT

Viewer • Updated May 30 • 7.99k • 44 • 1
PJMixers/mlabonne_orpo-dpo-mix-40k-PreferenceShareGPT

Viewer • Updated May 30 • 44.2k • 45 • 2
PJMixers/CyberNative_Code_Vulnerability_Security_DPO-PreferenceShareGPT

Viewer • Updated May 30 • 4.66k • 50 • 3
PJMixers/vicgalle_configurable-system-prompt-multitask-PreferenceShareGPT

Viewer • Updated May 30 • 1.95k • 48 • 5
PJMixers/mrfakename_identity_dpo-PreferenceShareGPT

Viewer • Updated May 30 • 22 • 51
PJMixers/Capx_Agentic-DPO-V0.1-PreferenceShareGPT

Viewer • Updated May 30 • 4.74k • 59 • 1
PJMixers/efederici_alpaca-vs-alpaca-orpo-dpo-PreferenceShareGPT

Viewer • Updated May 30 • 49.2k • 53
PJMixers/PKU-Alignment_PKU-SafeRLHF-Better-PreferenceShareGPT

Viewer • Updated May 30 • 330k • 43 • 1
PJMixers/PKU-Alignment_PKU-SafeRLHF-Safer-PreferenceShareGPT

Viewer • Updated May 30 • 330k • 62 • 1
PJMixers/winglian_no_robots_rlhf-PreferenceShareGPT

Viewer • Updated May 30 • 9.15k • 44
PJMixers/ResplendentAI_NSFW_RP_Format_DPO-PreferenceShareGPT

Updated May 30 • 39 • 2
PJMixers/ProlificAI_social-reasoning-rlhf-PreferenceShareGPT

Viewer • Updated May 30 • 3.82k • 41 • 3
PJMixers/trl-internal-testing_hh-rlhf-trl-style-PreferenceShareGPT

Viewer • Updated May 30 • 169k • 44 • 1
PJMixers/tasksource_oasst2_pairwise_rlhf_reward-PreferenceShareGPT

Viewer • Updated May 30 • 28.4k • 47 • 1
PJMixers/samhog_psychology-RLHF-PreferenceShareGPT

Viewer • Updated May 30 • 2k • 42 • 1
PJMixers/samhog_psychology-RLAIF-PreferenceShareGPT

Viewer • Updated May 30 • 2k • 39 • 1
PJMixers/fblgit_simple-math-DPO-PreferenceShareGPT

Viewer • Updated May 30 • 800k • 46
PJMixers/neovalle_H4rmony_dpo-PreferenceShareGPT

Viewer • Updated May 31 • 2.02k • 36 • 2
PJMixers/jondurbin_truthy-dpo-v0.1-PreferenceShareGPT

Viewer • Updated May 31 • 1.02k • 41 • 1
PJMixers/jondurbin_contextual-dpo-v0.1-PreferenceShareGPT

Viewer • Updated May 31 • 1.37k • 36 • 1
PJMixers/jondurbin_py-dpo-v0.1-PreferenceShareGPT

Viewer • Updated May 31 • 9.47k • 40 • 1
PJMixers/jondurbin_gutenberg-dpo-v0.1-PreferenceShareGPT

Viewer • Updated May 31 • 918 • 39 • 1
PJMixers/Undi95_Weyaxi-humanish-dpo-project-noemoji-PreferenceShareGPT

Viewer • Updated Jun 11 • 1.53k • 36 • 1
PJMixers/Magpie-Align_Magpie-Pro-DPO-200K-PreferenceShareGPT

Viewer • Updated Jul 12 • 207k • 48
PJMixers/Atsunori_HelpSteer2-DPO-PreferenceShareGPT

Viewer • Updated Jul 12 • 7.59k • 41 • 1
PJMixers/CultriX_gpt4-tinyllama-dpo-PreferenceShareGPT

Viewer • Updated Jul 12 • 20.5k • 39 • 1
PJMixers/princeton-nlp_llama3-ultrafeedback-armorm-PreferenceShareGPT

Viewer • Updated Jul 16 • 61.8k • 39
PJMixers/lemonilia_LimaRP-Only-NonSus-Simple-PreferenceShareGPT

Updated Jul 20 • 33
PJMixers/chargoddard_SlimOrcaDedupCleaned-Sonnet3.5-DPO-PreferenceShareGPT

Viewer • Updated Jul 23 • 168k • 38
PJMixers/Chaiverse-Leaderboard-PreferenceShareGPT

Viewer • Updated Aug 1 • 178k • 57 • 3
PJMixers/SillyTilly_PawanKrd-dpo-gpt-4o-reup-PreferenceShareGPT

Viewer • Updated Jul 29 • 12.4k • 39

Upvote