# Multi-agent Undercover Gaming: Hallucination Removal via Counterfactual Test for MM Reasoning

Source: https://www.youtube.com/watch?v=d-Y-FS0RTaQ
Recap page: https://rapidrecap.app/video/d-Y-FS0RTaQ
Generated: 2025-11-18T18:10:11.189+00:00

---
## Quick Overview

The Multi-Agent Undercover Gaming technique successfully proves that incorporating counterfactual testing into multi-agent reasoning systems significantly improves accuracy, outperforming baseline models like GPT-4V and Claude 3.5 Sonnet by a substantial margin (16 points higher on the hallucination benchmark) by forcing agents to verify claims against a generated counterfactual image, thus making the AI inherently more skeptical and robust against subtle factual errors.

**Key Points:**
- The Multi-Agent Undercover Gaming (MUG) technique achieved a 16-point accuracy boost over the baseline MAD approach on the hallucination benchmark.
- MUG forces agents to verify claims by cross-referencing a generated counterfactual image against the original prompt's context.
- The baseline MAD approach (using GPT-4V and Claude 3.5 Sonnet) scored 12.7% accuracy, whereas the MUG system achieved 28.7% accuracy.
- The core mechanism involves two phases: an undercover detection game followed by a summarization game.
- The experiment specifically tested agents' ability to identify subtle visual inconsistencies, such as a woman's hair color changing from red to dark brown in the counterfactual image.
- The MUG framework ensures agents actively probe for inconsistencies rather than relying solely on statistical consensus or simple visual matching.

![Screenshot at 04:44: The visual comparison showing the original image \(with red-haired woman\) and the flawed counterfactual image generated by the baseline model, highlighting the difference the MUG system is designed to catch.](https://ss.rapidrecap.app/screens/d-Y-FS0RTaQ/00-04-44.png)

**Context:** This video introduces a novel framework called Multi-Agent Undercover Gaming (MUG) designed to combat hallucination errors in Large Language Models (LLMs) during complex, multi-modal reasoning tasks. The context involves agents tasked with determining the subject of an image based on a prompt, where standard methods often fail due to reliance on statistical patterns or lack of internal verification mechanisms.

## Detailed Analysis

The video details the Multi-Agent Undercover Gaming (MUG) framework, a sophisticated method for removing hallucinations in LLMs performing multi-modal reasoning. The process involves two agents: an undercover agent and a detective agent. In the first phase, the undercover agent receives a prompt and generates an image, which is then slightly altered (counterfactually) to contain subtle errors. The detective agent's task is to identify the actual agent (the one who created the *original* image) by detecting these subtle errors, thereby forcing the system to engage in rigorous verification rather than relying on statistical consensus or simple visual similarity. The paper cited demonstrates that MUG significantly outperforms the baseline MAD (Multi-Agent Debate) approach. For instance, MAD scored 12.7% accuracy on hallucination detection, while MUG achieved 28.7% accuracy, a massive 16-point increase. The success stems from forcing the AI to check for logical consistency and subtle visual discrepancies (like hair color changes or object swaps) rather than just agreeing on surface-level features. The MUG system effectively weaponizes disagreement to enforce a higher standard of factual verification, leading to more robust and reliable reasoning.

### MUG Framework Overview

- Two phases: Undercover Detection Game and Summarization Game
- Agents probe for inconsistencies to enforce verification
- Successfully detects subtle errors like hair color changes.

### Experimental Results

- MUG accuracy reached 28.7% on hallucination detection, beating baseline MAD (12.7%) by 16 points
- MUG outperformed GPT-4V and Claude 3.5 Sonnet benchmarks.

### Key Constraints

- Requires agents to search for factual verification
- Must avoid simple majority rule consensus
- Forces agents to actively question and defend their reasoning against counterfactuals.

![Screenshot at 00:00: Introductory screen displaying the podcast promotion graphic within an oscilloscope-like frame, signaling the start of the discussion.](https://ss.rapidrecap.app/screens/d-Y-FS0RTaQ/00-00-00.png)
![Screenshot at 00:15: Speaker explicitly states the problem: LLMs give answers with absolute confidence that are factually wrong.](https://ss.rapidrecap.app/screens/d-Y-FS0RTaQ/00-00-15.png)
![Screenshot at 02:22: Speaker introduces the two phases of the MUG system: Undercover Detection Game and Summarization Game.](https://ss.rapidrecap.app/screens/d-Y-FS0RTaQ/00-02-22.png)
![Screenshot at 03:33: Visual demonstration of the difference: the original image \(correct\) versus the counterfactual image \(incorrect hair color\).](https://ss.rapidrecap.app/screens/d-Y-FS0RTaQ/00-03-33.png)
![Screenshot at 04:47: Speaker notes that even when the fake image is subtle, the system's rigor is maintained.](https://ss.rapidrecap.app/screens/d-Y-FS0RTaQ/00-04-47.png)
![Screenshot at 07:03: Speaker highlights the shift from statistical consensus to direct factual verification as the core innovation.](https://ss.rapidrecap.app/screens/d-Y-FS0RTaQ/00-07-03.png)
![Screenshot at 08:58: Visual representation of the audio waveform peaking during the discussion of the quantitative results.](https://ss.rapidrecap.app/screens/d-Y-FS0RTaQ/00-08-58.png)
![Screenshot at 10:17: Speaker cites the specific performance metric: a 16-point accuracy boost over the baseline.](https://ss.rapidrecap.app/screens/d-Y-FS0RTaQ/00-10-17.png)