Hierarchical Reasoning Model

AI-generated keywords: Hierarchical Reasoning Model Artificial Intelligence Sapient Intelligence Recurrent Architecture Human Brain

AI-generated Key Points

  • The Hierarchical Reasoning Model (HRM) is a revolutionary recurrent architecture developed by Sapient Intelligence in Singapore to address reasoning challenges in artificial intelligence.
  • HRM utilizes a hierarchical and multi-timescale processing approach inspired by the human brain, consisting of two interdependent recurrent modules: a high-level module for abstract planning and a low-level module for detailed computations.
  • With only 27 million parameters, HRM outperforms larger models on complex reasoning tasks with just 1000 training samples, particularly excelling at tasks like solving complex Sudoku puzzles and navigating large mazes.
  • HRM achieves exceptional performance on benchmarks like the Abstraction and Reasoning Corpus (ARC) without requiring pre-training or Chain-of-Thought (CoT) data.
  • These results demonstrate HRM's potential as a transformative advancement towards universal computation and general-purpose reasoning systems in AI.
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Authors: Guan Wang, Jin Li, Yuhao Sun, Xing Chen, Changling Liu, Yue Wu, Meng Lu, Sen Song, Yasin Abbasi Yadkori

License: CC BY 4.0

Abstract: Reasoning, the process of devising and executing complex goal-oriented action sequences, remains a critical challenge in AI. Current large language models (LLMs) primarily employ Chain-of-Thought (CoT) techniques, which suffer from brittle task decomposition, extensive data requirements, and high latency. Inspired by the hierarchical and multi-timescale processing in the human brain, we propose the Hierarchical Reasoning Model (HRM), a novel recurrent architecture that attains significant computational depth while maintaining both training stability and efficiency. HRM executes sequential reasoning tasks in a single forward pass without explicit supervision of the intermediate process, through two interdependent recurrent modules: a high-level module responsible for slow, abstract planning, and a low-level module handling rapid, detailed computations. With only 27 million parameters, HRM achieves exceptional performance on complex reasoning tasks using only 1000 training samples. The model operates without pre-training or CoT data, yet achieves nearly perfect performance on challenging tasks including complex Sudoku puzzles and optimal path finding in large mazes. Furthermore, HRM outperforms much larger models with significantly longer context windows on the Abstraction and Reasoning Corpus (ARC), a key benchmark for measuring artificial general intelligence capabilities. These results underscore HRM's potential as a transformative advancement toward universal computation and general-purpose reasoning systems.

Submitted to arXiv on 26 Jun. 2025

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

AI assistant instructions?

Results of the summarizing process for the arXiv paper: 2506.21734v1

The Hierarchical Reasoning Model (HRM) is a revolutionary recurrent architecture developed by the team at Sapient Intelligence in Singapore to tackle the challenge of reasoning in artificial intelligence. Unlike current large language models that rely on Chain-of-Thought (CoT) techniques, HRM utilizes a hierarchical and multi-timescale processing approach inspired by the human brain. This model consists of two interdependent recurrent modules: a high-level module for abstract planning and a low-level module for detailed computations. With only 27 million parameters, HRM achieves exceptional performance on complex reasoning tasks with just 1000 training samples, surpassing larger models on benchmarks like the Abstraction and Reasoning Corpus (ARC). The model does not require pre-training or CoT data and excels at tasks such as solving complex Sudoku puzzles and navigating large mazes. These results highlight HRM's potential as a transformative advancement towards universal computation and general-purpose reasoning systems in AI.
Created on 30 Aug. 2025

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

Similar papers summarized with our AI tools

Navigate through even more similar papers through a

tree representation

Look for similar papers (in beta version)

By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.