arXiv 2510.13651
What is the objective of reasoning with reinforcement learning?
By Damek Davis and Benjamin Recht
Published 2025-10-15
Mindmap
Browse the paper's core ideas, clusters, and relationships in a structured outline.
We show that several popular algorithms for reinforcement learning in large language models with binary rewards can be viewed as stochastic gradient ascent on a monotone transform of the probability of a correct answer given a prompt. In particular, the transformation associated with rejection sampling algorithms is the logarithm and that associated with the GRPO algorithm is the arcsine of the square root.