# MiroThinker: Pushing the Performance Boundaries of Open-Source Research Agents

Source: https://www.youtube.com/watch?v=56czxvJTcME
Recap page: https://rapidrecap.app/video/56czxvJTcME
Generated: 2025-11-21T19:34:40.649+00:00

---
## Quick Overview

The MiroThinker research agent significantly outperforms other open-source models on the HumanEval benchmark, achieving 89.4% accuracy by employing a novel iterative training blueprint that incorporates reinforcement learning via group relative preference optimization (GRPO) to intelligently manage tool use and context.

**Key Points:**
- MiroThinker achieved 89.4% accuracy on the HumanEval benchmark, surpassing the previous open-source leader by over 6 percentage points.
- The key to this performance is a three-stage training blueprint: Stage 1 is basic tool use training, Stage 2 is preference optimization (DPO), and Stage 3 is Reinforcement Learning (RL) via GRPO.
- The context window used for testing the model was 256K tokens, allowing for complex, long reasoning chains.
- MiroThinker excels by focusing on interaction depth, using iterative refinement, seeking feedback, and self-correcting mid-task, rather than just increasing model size or context length.
- The agent employs a modular tool interface, allowing it to safely search the web, run code in a sandboxed environment, and use tools like PDF scrapers.
- The method avoids common pitfalls like relying on overly long context windows (e.g., 128K/256K) or poor tool usage, which plagued previous models.

![Screenshot at 01:23: The speaker points out that the open-source world has struggled to match proprietary systems, setting up the context for MiroThinker's performance improvements.](https://ss.rapidrecap.app/screens/56czxvJTcME/00-01-23.png)

**Context:** This video discusses the MiroThinker research agent, a significant advancement in open-source AI agents designed for complex, multi-step tasks. The speakers compare MiroThinker's capabilities, particularly its performance on benchmarks like HumanEval, against proprietary systems like GPT-4 and other open-source models, emphasizing that its success stems from a sophisticated, iterative training methodology focused on intelligent tool selection and self-correction rather than simply scaling up model size.

## Detailed Analysis

The discussion centers on the MiroThinker research agent and its superior performance compared to existing open-source models, especially on the HumanEval benchmark where it achieved 89.4% accuracy, beating the prior open-source leader by over 6 percentage points. The presenters detail the three-stage training blueprint responsible for this leap: Stage 1 involves teaching basic tool use (like web search or code execution in a sandbox), Stage 2 introduces Direct Preference Optimization (DPO) to refine decision-making based on human feedback, and Stage 3 utilizes Reinforcement Learning via Group Relative Preference Optimization (GRPO). This GRPO stage teaches the model to be judicious about when to use tools and how to manage complex reasoning chains across its large context window (tested at 256K tokens). The paper emphasizes that this method focuses on increasing the 'interaction depth'—how intelligently the agent uses tools and corrects itself—rather than just feeding it more data or increasing its context size, which the presenters suggest is a less effective scaling vector. The success is quantified by showing that MiroThinker achieves state-of-the-art results for its size class on benchmarks like HumanEval and Chinese browsing benchmarks, proving that better training methodology trumps sheer size alone.

### MiroThinker Performance

- Achieved 89.4% accuracy on HumanEval, outperforming proprietary models like GPT-4 and open-source leaders by over 6 points
- Outperformed Big 72B model on GAIA benchmark (89.4% vs 81.7%)

### Training Blueprint

- Three stages—Stage 1 (Basic Tool Use), Stage 2 (DPO for preference optimization), Stage 3 (RL via GRPO for intelligent tool selection and self-correction)

### Key Advantage

- Focus on interaction depth and iterative behavior rather than just increasing model size or context window length
- Enables better handling of complex, multi-step reasoning tasks

### Tool Usage

- Agent has access to tools like web search, Python execution sandbox, and PDF scraping tools, all managed within a safe execution environment
- Agent learns when to use tools and when to rely on internal reasoning.

### Limitations Overcome

- Avoids issues seen in previous models, such as relying on overly long context windows (128K/256K) for simple tasks or failing to execute basic steps correctly.

![Screenshot at 00:00: The introductory screen featuring the podcast hosts and the call to action to 'Become a Member Today!'](https://ss.rapidrecap.app/screens/56czxvJTcME/00-00-00.png)
![Screenshot at 01:10: Visual representation of the three training stages \(Tool Augmented Agents, Reinforcement Learning, and Interactive Scaling\).](https://ss.rapidrecap.app/screens/56czxvJTcME/00-01-10.png)
![Screenshot at 02:28: Visual depiction of the agent performing self-correction during the training process.](https://ss.rapidrecap.app/screens/56czxvJTcME/00-02-28.png)
![Screenshot at 04:47: Slide comparing MiroThinker's performance \(89.4% accuracy\) against the proprietary GPT-5 High model \(81.7% accuracy\) on the HumanEval benchmark.](https://ss.rapidrecap.app/screens/56czxvJTcME/00-04-47.png)
![Screenshot at 07:24: Visual representation of the three training stages \(Tool Use, DPO, and RL/GRPO\) being applied to achieve better results.](https://ss.rapidrecap.app/screens/56czxvJTcME/00-07-24.png)