PPO: Proximal Policy Optimization Algorithms Published on Jul 20, 2017 Updated on Jan 15, 2026 Reinforcement Learning Reinforcement Learning One minuteContents TL;DRMotivations & InnovationsApproachModelTraining RecipeData RecipeExperimentsOpenAI arXiv 1707.06347 TL;DRMotivations & InnovationsApproachModelTraining RecipeData RecipeExperimentsRelated PostsDirect Preference Optimization (DPO): Your Language Model is Secretly a Reward Model 2023-05-29InstructGPT: Training language models to follow instructions with human feedback 2022-03-04
