Direct Preference Optimization (DPO): Your Language Model is Secretly a Reward Model2023-05-29Reinforcement LearningReinforcement Learning