# How A Team Of 7 Keeps Breaking AI Benchmark Records

Source: https://www.youtube.com/watch?v=UPGB-hsAoVY
Recap page: https://rapidrecap.app/video/UPGB-hsAoVY
Generated: 2026-02-27T15:32:41.89+00:00

---
## Quick Overview

Poetiq, co-founded by Ian Fischer, achieves superior AI performance by using a recursively self-improving system that utilizes reasoning strategies instead of relying solely on massive prompt engineering or fine-tuning existing foundation models, allowing them to significantly outperform models like Gemini 1.5 Flash on benchmarks such as Humanity's Last Exam.

**Key Points:**
- Poetiq's recursive self-improving system, which incorporates reasoning strategies, allows them to outperform models like Gemini 1.5 Flash on specific benchmarks.
- The company's latest paper showed a 9% improvement over Gemini 3 DeepMind on 'Humanity's Last Exam,' scoring 53.1% versus 44%.
- The training cost for the winning model was significantly lower, around $70 to $80 per problem, compared to the massive expense of training foundation models from scratch.
- Fischer noted that in the past, machine learning required knowing your dataset well, but Poetiq's approach outsources this data understanding to the AI agent itself.
- The system generates its own reasoning strategies and can iteratively self-improve, leading to better performance than relying solely on prompt engineering or fine-tuning.
- Fischer, formerly a researcher at Google DeepMind, co-founded Poetiq with Shameet Baluja, and previously founded a mobile dev tools company acquired by YC.

![Screenshot at 00:46: Ian Fischer's company, Poetiq, is introduced with the tagline "The fastest path to safe super intelligence. Paved with better reasoning."](https://ss.rapidrecap.app/screens/UPGB-hsAoVY/00-00-46.jpg)

**Context:** The video features a discussion on the Y Combinator (YC) podcast, Lightcone, with Ian Fischer, Co-founder & Co-CEO of Poetiq, alongside YC partners Diana Hu, Harj Taggar, Garry Tan, and Jared Friedman. Fischer explains Poetiq's approach to Artificial Intelligence, which focuses on recursive self-improvement and reasoning strategies, contrasting it with the prevailing methods of massive pre-training or prompt engineering of large language models (LLMs).

## Detailed Analysis

Ian Fischer, Co-founder & Co-CEO of Poetiq, discusses how the world is changing quickly due to AI, referencing his experience building an iPhone app last summer using GPT-4, which was fast and easy compared to a decade ago. He explains that Poetiq is focused on building a recursively self-improving system, which he calls the 'Holy Grail of AI,' where the AI makes itself smarter. This approach allows them to achieve better performance than competitors who rely on training massive LLMs from scratch, which is extremely costly (hundreds of millions of dollars) and time-consuming (months of effort). Poetiq's method results in systems that solve hard problems more cheaply and quickly. When asked about the difference from RL or context engineering, Fischer explains that Poetiq's systems, which they call the Poetiq Meta-System, generate their own reasoning strategies. He highlights their recent success on 'Humanity's Last Exam,' where they scored 53.1% compared to Gemini 1.5 Flash's 44%—a significant margin achieved with far lower optimization costs (under $100k). He contrasts this with the traditional method where engineers had to meticulously know and curate the dataset; Poetiq outsources this understanding to the AI agent itself. The recursive process means that as the Poetiq Meta-System improves, it can find better reasoning strategies, leading to continual performance gains, even as foundation models like GPT-4 release newer versions.

### Poetiq's Core Technology

- Building a recursively self-improving system
- The system generates its own reasoning strategies
- The goal is achieving high performance without massive computational expense.

### Benchmark Performance

- Poetiq achieved 53.1% on Humanity's Last Exam
- This beat Gemini 1.5 Flash's 44% score
- Optimization costs were less than $100k.

### Contrast with Traditional AI

- Moving away from relying solely on prompt engineering or fine-tuning foundation models
- Traditional methods require knowing the dataset well, whereas Poetiq's AI understands the data itself.

### Founders' Background

- Ian Fischer previously worked at Google DeepMind for a decade and founded a mobile dev tools company acquired by YC
- Fischer transitioned from pure ML research to focus on robotics and then AI/robotics.

### Call to Action (Host)

- Garry Tan encourages viewers to apply to Y Combinator now, noting it's never too early to level up an idea.

![Screenshot at 00:00: The five panelists, including Ian Fischer \(center\), begin the YC Lightcone podcast discussion.](https://ss.rapidrecap.app/screens/UPGB-hsAoVY/00-00-00.jpg)
![Screenshot at 00:42: Garry Tan asks Ian Fischer to describe Poetiq and how it differs from standard RL approaches.](https://ss.rapidrecap.app/screens/UPGB-hsAoVY/00-00-42.jpg)
![Screenshot at 00:46: The Poetiq landing page is displayed, emphasizing 'better reasoning' as the path to safe super intelligence.](https://ss.rapidrecap.app/screens/UPGB-hsAoVY/00-00-46.jpg)
![Screenshot at 01:02: Garry Tan questions Fischer on what Poetiq is and how it differs from context engineering.](https://ss.rapidrecap.app/screens/UPGB-hsAoVY/00-01-02.jpg)
![Screenshot at 03:33: Ian Fischer details the high cost and time involved in training new LLMs from scratch, contrasting it with Poetiq's approach.](https://ss.rapidrecap.app/screens/UPGB-hsAoVY/00-03-33.jpg)