arXiv 2505.22094

ReinFlow: Fine-tuning Flow Matching Policy with Online Reinforcement Learning

By Tonghe Zhang, Chao Yu, et al.

Published 2025-05-28

Mindmap

Browse the paper's core ideas, clusters, and relationships in a structured outline.

We propose ReinFlow, a simple yet effective online reinforcement learning (RL) framework that fine-tunes a family of flow matching policies for continuous robotic control. Derived from rigorous RL theory, ReinFlow injects learnable noise into a flow policy's deterministic path, converting the flow into a discrete-time Markov Process for exact and straightforward likelihood computation. This conversion facilitates ex…

View the original paper on arXiv