arXiv 2510.04871
Less is More: Recursive Reasoning with Tiny Networks
By Alexia Jolicoeur-Martineau
Published 2025-10-06
Citation lineage
Review the prior work and downstream research connected to this paper.
Hierarchical Reasoning Model (HRM) is a novel approach using two small neural networks recursing at different frequencies. This biologically inspired method beats Large Language models (LLMs) on hard puzzle tasks such as Sudoku, Maze, and ARC-AGI while trained with small models (27M parameters) on small data (around 1000 examples). HRM holds great promise for solving hard problems with small networks, but it is not…