# Towards Understanding Distilled Reasoning Models: A Representational Approach

**Authors:** David D. Baek, Max Tegmark  
**arXiv:** [2503.03730](https://arxiv.org/abs/2503.03730)  
**Date:** 2025-03-05  
**Summary page:** https://www.summarizepaper.com/en/paper/2503.03730v1/

## Key points

- Large language models (LLMs) like Transformer architecture and OpenAI's GPT series
- Scaled up to unprecedented sizes for breakthroughs in performance and capabilities
- Encourages models to articulate intermediate steps in reasoning process
- Enables more complex problem-solving
- Models like o1 and Deepseek-R1 demonstrate exceptional performance on logical inference tasks
- Used for model distillation, transferring knowledge from larger models to smaller ones
- Distinctive features developed by distilled models and their impact on reasoning capabilities
- Unique features exhibited by distilled models with increasing base model size
- Changes in feature geometry post-distillation
- Sparse crosscoder framework introduction
- Examination of unique features of distilled models
- Analysis of feature faithfulness through experiments and steering techniques
- Exploration of changes in feature geometry post-distillation
- To gain deeper insights into how distillation alters LLMs, contributing to improving transparency and reliability in AI systems.

## Summary

In recent years, the field of natural language processing has seen significant advancements in large language models (LLMs) like the Transformer architecture and OpenAI's GPT series. These models have been scaled up to unprecedented sizes, leading to breakthroughs in performance and capabilities. One key development that has further enhanced these models is the integration of chain-of-thought reasoning methods, which encourage models to articulate intermediate steps in their reasoning process, enabling more complex problem-solving. While most improvements in LLMs have come from scale and supervised fine-tuning, reinforcement learning (RL) has emerged as a promising approach to enhance reasoning abilities. Models like o1 and Deepseek-R1 have demonstrated exceptional performance on tasks requiring logical inference through RL fine-tuning. Additionally, the output from these reasoning models has been used for model distillation, where knowledge is transferred from larger models to smaller ones. Despite the success of model distillation, there remains a gap in understanding how this process modifies the model. This study aims to address three key questions: 1) What distinctive features do distilled models develop and how do they impact reasoning capabilities? 2) Do distilled models exhibit more unique features as base model size increases? 3) How does feature geometry change as a result of distillation? By exploring these questions, researchers aim to gain deeper insights into how distillation alters LLMs, ultimately contributing to improving transparency and reliability in AI systems. The paper reviews related literature, introduces the sparse crosscoder framework, examines unique features of distilled models, delves into specific types of reasoning features, analyzes feature faithfulness through experiments and steering techniques, explores changes in feature geometry post-distillation, and concludes with implications for building safe and robust AI models.