# Figure It Out: Improve the Frontier of Reasoning with Executable Visual States

Source: https://www.youtube.com/watch?v=VKW1W6rvCfI
Recap page: https://rapidrecap.app/video/VKW1W6rvCfI
Generated: 2026-01-11T16:35:05.649+00:00

---
## Quick Overview

The paper Figure It Out introduces a powerful new approach to AI reasoning that combines executable visual states with symbolic manipulation, allowing models to actively construct and reason about visual information like geometry and structure, leading to a significant performance improvement of 13% over text-only baselines on complex problems involving spatial reasoning.

**Key Points:**
- Figure It Out (FiG) represents a breakthrough in AI reasoning by integrating executable visual states with symbolic reasoning.
- The method enables AI models to actively sketch out and reason about spatial problems, such as geometry, by using visual thinking as an intermediate step.
- The approach significantly outperformed text-only models, showing a 13% accuracy improvement on complex math benchmarks like those involving trigonometric functions and quadratic equations.
- FiG avoids the pitfalls of pure text models, which often fail on spatial tasks due to misinterpreting inequalities or relying on incorrect algebraic chains.
- The system works by pausing text generation to output a visual snippet (a sketch), which is then interpreted and used to guide subsequent reasoning steps, ensuring mathematical consistency.
- The paper demonstrates that this visual intermediate representation allows the model to construct a verifiable reality, leading to more robust solutions than models relying solely on symbolic manipulation.

![Screenshot at 00:05: The visual display of the two podcast hosts, illustrating the context of the 'AI Papers Daily' podcast discussing the research breakthrough in AI reasoning.](https://ss.rapidrecap.app/screens/VKW1W6rvCfI/00-00-05.jpg)

**Context:** The video discusses a research paper titled "Figure It Out: Improve the Frontier of Reasoning with Executable Visual States," which proposes a novel method for enhancing the reasoning capabilities of large language models (LLMs). The core idea is to move beyond purely symbolic reasoning by allowing the model to generate and interact with visual representations of a problem, treating this visual output as an executable state to guide its logical steps, particularly for problems with spatial or geometric components.

## Detailed Analysis

The presentation details a significant advancement in AI reasoning called Figure It Out (FiG), which addresses the limitations of models relying solely on text by integrating executable visual states. The speakers explain that existing solutions fail because they try to handle complex spatial or geometric problems purely through symbolic manipulation, often leading to errors like misinterpreting inequalities or creating flawed algebraic chains. FiG introduces a crucial step where the model pauses its text generation to actively draw or sketch a visual representation of the problem. This visual output acts as a verifiable intermediate step, allowing the model to construct a more robust understanding of spatial relationships (like geometry, angles, or graphs) that it can reason about. The paper tested this approach against a baseline text-only model on the BeyondDaME dataset, which is designed to be hard for text-only models. FiG achieved a 13% improvement over the text-only baseline, demonstrating that this visual guidance leads to more accurate and reliable results, especially for problems requiring geometric understanding. The speaker contrasts this with the reliance on simple text-based solvers which often result in an 'overuse abandonment cycle' where the model fails completely when the problem complexity increases. The success of FiG lies in its ability to use the visual output to guide its symbolic reasoning, ensuring the final solution adheres to geometric constraints, making the process much more reliable for complex tasks.

### Introduction to FiG

- Diving deep into a significant breakthrough in LLM reasoning
- The method integrates executable visual states with symbolic reasoning
- It helps solve complex problems involving space and geometry.

### Failure of Current Models

- Text-only models fail on complex spatial problems due to errors in symbolic manipulation
- They misinterpret inequalities and rely on flawed algebraic chains.

### The FiG Mechanism

- Model pauses text generation to output a visual snippet (a sketch)
- This visual state guides subsequent reasoning steps
- The process enforces mathematical consistency.

### Experimental Results

- FiG showed a 13% accuracy improvement over text-only baselines on complex math benchmarks
- Benchmarks included trigonometry and quadratic functions.

### The Value of Visuals

- The advantage is not just seeing the image, but the active control over constructing the visual reality
- This active construction leads to more robust reasoning.

### Conclusion on Impact

- FiG suggests a profound shift toward models that can construct and reason about verifiable visual worlds, moving beyond simple symbolic processing.

![Screenshot at 00:05: The opening slide showing the podcast hosts and the central theme of the discussion: improving reasoning with executable visual states.](https://ss.rapidrecap.app/screens/VKW1W6rvCfI/00-00-05.jpg)
![Screenshot at 00:29: The speaker explicitly states the paper is about AI creating its own diagrams and blueprints, highlighting the visual nature of the research.](https://ss.rapidrecap.app/screens/VKW1W6rvCfI/00-00-29.jpg)
![Screenshot at 01:39: The visual representation of the function being plotted, illustrating the precise graphical output the model can generate.](https://ss.rapidrecap.app/screens/VKW1W6rvCfI/00-01-39.jpg)
![Screenshot at 03:04: A comparison is made between a simple napkin sketch and a proper architectural CAD file, emphasizing the model's ability to produce high-fidelity, accurate visuals.](https://ss.rapidrecap.app/screens/VKW1W6rvCfI/00-03-04.jpg)
![Screenshot at 05:58: A visual representation of the output graph showing the model's performance improvement \(the curve staying above the baseline\) when using the visual guidance.](https://ss.rapidrecap.app/screens/VKW1W6rvCfI/00-05-58.jpg)