# Current AI Models have 3 Unfixable Problems

Source: https://www.youtube.com/watch?v=984qBh164fo
Recap page: https://rapidrecap.app/video/984qBh164fo
Generated: 2025-10-19T15:32:17.595+00:00

---
## Quick Overview

Current Large Language Models (LLMs) possess three fundamental, unfixable problems—Abstraction, Security, and Generalization—because they rely on pattern matching from training data rather than true abstract reasoning, making them inherently untrustworthy and susceptible to prompt injection attacks, which can override system instructions.

**Key Points:**
- LLMs are fundamentally limited because they rely on pattern matching (interpolation) of training data, not true abstract reasoning or extrapolation.
- The current approach of rewarding confident guessing over uncertainty leads to AI 'hallucinations' that undermine user trust.
- A proposed solution involving expressing uncertainty (e.g., saying 'I don't know' 30% of the time) would likely cause users to abandon the systems rapidly due to low user engagement.
- The three core, unfixable problems identified are Abstraction, Security, and Generalization, all stemming from their reliance on data patterns.
- Prompt injection, where input overrides system instructions, is an example of the security weakness stemming from the lack of abstract reasoning.
- The speaker promotes Incogni as a solution to data broker issues, offering to automate the removal of personal data for a 60% discount using code SABINE.

![Screenshot at 0:00: Sabine Hossenfelder introduces the topic of Artificial General Intelligence \(AGI\) and the difficulty in achieving human-level intelligence in current AI models.](https://ss.rapidrecap.app/screens/984qBh164fo/00-00-00.png)

**Context:** The video features Sabine Hossenfelder discussing the inherent limitations of current Large Language Models (LLMs) like ChatGPT, arguing that achieving Artificial General Intelligence (AGI) comparable to humans is difficult because these models only perform interpolation based on training data rather than true abstract reasoning or extrapolation. She references a recent paper arguing that rewarding confident answers over uncertainty exacerbates hallucinations and discusses the practical implications, such as user abandonment if models frequently state they don't know the answer.

## Detailed Analysis

Sabine Hossenfelder argues that achieving Artificial General Intelligence (AGI) comparable to humans is difficult because current AI models, based on Deep Neural Nets and diffusion models, are trained on patches of images or word/phrase patterns, meaning they are excellent at interpolation (summarizing or generating content similar to what they have seen) but struggle with extrapolation (reasoning beyond their training data). This reliance on pattern matching leads to three fundamental, unfixable problems: Abstraction, Security, and Generalization. She cites research suggesting that if models were trained to express uncertainty (e.g., admitting they don't know up to 30% of the time), users would quickly abandon them due to poor user experience, drawing a parallel to air-quality monitoring systems where uncertainty flags reduce engagement. Furthermore, the lack of true abstract reasoning makes them vulnerable to prompt injection attacks, where users can change the model's instructions, as demonstrated by examples of users manipulating customer service bots. Because LLMs cannot distinguish between instructions and queries, they follow the input string rather than their core programming. Hossenfelder concludes that current models will likely remain untrustworthy for many tasks requiring abstract reasoning or novel problem-solving, and companies relying on massive valuations based on these limitations risk those valuations evaporating. The video concludes with an endorsement for Incogni, a service that automates data removal from data brokers, offering a 60% discount with the code SABINE.

### The AGI Problem

- Difficulty in achieving human-level intelligence
- Models are based on Deep Neural Nets and diffusion models
- They excel at interpolation (pattern matching) but fail at extrapolation (abstract reasoning)

### Three Core Flaws

- Abstraction, Security, and Generalization are unfixable issues
- Models suffer from prompt injection due to inability to distinguish instructions from queries
- Current evaluation methods reward guessing over uncertainty, causing hallucinations

### User Experience Impact

- If ChatGPT admitted uncertainty 30% of the time, users would abandon it rapidly
- Analogous to air-quality monitoring systems where uncertainty reduces user engagement

### Data Broker Issues & Incogni Promotion

- Data brokers compile and sell shadow profiles based on user data
- Incogni automates the removal process, saving users an estimated 304 hours of work
- Discount offer: Use code SABINE for 60% off Incogni

![Screenshot at 0:00: Host Sabine Hossenfelder introduces the topic of Artificial General Intelligence \(AGI\) against a background graphic symbolizing circuitry and a synthetic face.](https://ss.rapidrecap.app/screens/984qBh164fo/00-00-00.png)
![Screenshot at 0:26: Visual representation of data flowing into a Deep Neural Net structure, illustrating the pattern-matching basis of current AI.](https://ss.rapidrecap.app/screens/984qBh164fo/00-00-26.png)
![Screenshot at 0:38: A screen displaying 'Chat AI - Generative smart conversation' highlights the current capabilities LLMs possess.](https://ss.rapidrecap.app/screens/984qBh164fo/00-00-38.png)
![Screenshot at 1:22: A psychedelic visual transition accompanies the introduction of the problem of 'Hallucinations' in AI models.](https://ss.rapidrecap.app/screens/984qBh164fo/00-01-22.png)
![Screenshot at 1:28: A social media post screenshot illustrating an AI hallucination: answering 'The letter "R" has 3 strawberries' to a nonsensical question.](https://ss.rapidrecap.app/screens/984qBh164fo/00-01-28.png)
![Screenshot at 2:04: A clip from a game show where the host says 'Hey, man... Close enough,' used to illustrate the issue of LLMs providing plausible but incorrect answers instead of admitting uncertainty.](https://ss.rapidrecap.app/screens/984qBh164fo/00-02-04.png)
![Screenshot at 2:49: Visual comparison of a green checkmark gear \(correct\) versus a red X gear \(incorrect\), symbolizing the binary classification issue in AI where uncertainty is not properly handled.](https://ss.rapidrecap.app/screens/984qBh164fo/00-02-49.png)
![Screenshot at 4:21: Gary Marcus is shown, credited with the concept that current models only perform interpolation \(good\) but not extrapolation \(bad\).](https://ss.rapidrecap.app/screens/984qBh164fo/00-04-21.png)
![Screenshot at 5:11: Text overlay listing the three core unfixable problems: Abstraction, Security, and Generalization, each with a thumbs-down icon.](https://ss.rapidrecap.app/screens/984qBh164fo/00-05-11.png)
![Screenshot at 7:04: The Incogni website highlights its mission to help users take back control of their data privacy.](https://ss.rapidrecap.app/screens/984qBh164fo/00-07-04.png)