# The Anointment Effect: How a Questionable “MIT Study” Became Gospel Source: https://www.youtube.com/watch?v=vtvwln8Hl6c Recap page: https://rapidrecap.app/video/vtvwln8Hl6c Generated: 2026-02-01T16:03:16.956+00:00 --- ## Quick Overview The study claiming 95% of corporate AI investments fail lacks scientific rigor, as it relies on a convenience sample and the authority of the MIT logo, ultimately revealing a fundamental flaw in how the media and potentially the industry value AI success metrics. **Key Points:** - The referenced study claiming 95% of corporate AI investments fail is not a rigorous, peer-reviewed MIT study, but rather based on a convenience sample. - The study's findings, which are highly cited in headlines, rely on the perceived authority of the MIT name rather than solid methodology. - The sampling method involved interviewing people easily accessible (like at an AI conference) or those willing to talk, leading to a skewed dataset heavily favoring failure narratives. - The analysis suggests that the media amplified the 95% failure rate, which was derived from assessing projects that didn't have clear definitions of success (like ROI) or clear protocols for verification. - The underlying issue is the 'Anointment Effect,' where institutional prestige (like MIT) bypasses scrutiny, making the statistic seem credible even when the methodology is flawed. - The proposed solution is a fundamental shift in how information is valued, requiring auditing the source/methodology, rather than just accepting prestigious labels. - The speaker argues that the industry is moving toward an 'Era of Infinite Artifacts,' demanding new critical literacy skills to verify claims, especially those that seem too simple or too dire. ![Screenshot at 00:17: The speaker begins detailing the critique by highlighting the claim's prevalence in headlines and investment memos, setting up the central argument against the credibility of the 95% failure statistic.](https://ss.rapidrecap.app/screens/vtvwln8Hl6c/00-00-17.jpg) **Context:** The discussion centers on a widely circulated statistic—often attributed to MIT—claiming that 95% of corporate Artificial Intelligence (AI) investments are failing. The speaker critiques this statistic, arguing it is not scientifically sound due to its methodological flaws, specifically its reliance on a skewed convenience sample and the undue influence of the MIT brand reputation, which he terms the 'Anointment Effect.' ## Detailed Analysis The video debunks the frequently cited statistic that 95% of corporate AI investments fail, attributing the statistic's wide acceptance to the 'Anointment Effect,' where prestige, like the MIT logo, overrides skepticism about methodology. The speaker cites Toby Stuart's critique, noting that the study cited was neither a definitive MIT study nor peer-reviewed in a rigorous way. The data compilation involved a convenience sample—interviewing people easily accessible at conferences or willing to talk—which skewed the results toward failure narratives (01:22, 04:54). Stuart suggests this reliance on convenience sampling, coupled with a lack of clear success metrics (like ROI) in the audited projects, made the 95% failure rate seem compelling but ultimately flawed (03:22, 04:44). The core issue is that the media used the MIT brand as a shortcut to legitimacy, allowing the high failure rate to bypass scrutiny (06:57). The speaker concludes that this incident shows a fundamental shift: in an era of massive AI-generated content, critical skills like auditing methodology and source credibility are essential civic skills, rather than simply trusting prestigious labels (09:51, 11:23). ### Critique of the 95% Failure Statistic - The statistic claiming 95% of AI investments fail is based on a convenience sample, not rigorous MIT research - The media amplified this rate by leveraging the MIT brand for credibility, creating an 'Anointment Effect' - The study failed to adequately audit the source or methodology of the failures it cited. ### The Flaw in Methodology - The sampling was based on easily accessible individuals, leading to a biased dataset - The failure rate calculation was based on projects lacking clear ROI definitions or rigorous verification protocols - The reliance on institutional prestige allowed the questionable statistic to become gospel. ### The Way Forward - The speaker advocates for critical evaluation (auditing source code/methodology) rather than accepting claims based on brand names - This requires a new form of literacy in the age of infinite AI-generated content - The alternative path involves slowing down verification processes instead of relying on speed and hype. ![Screenshot at 00:00: Video introduction with the title graphic featuring two podcasters and the text 'BECOME A MEMBER TODAY!' overlaid on a soundwave grid.](https://ss.rapidrecap.app/screens/vtvwln8Hl6c/00-00-00.jpg) ![Screenshot at 00:18: The speaker introduces the central claim being discussed: the statistic that 95% of corporate AI investments are failing.](https://ss.rapidrecap.app/screens/vtvwln8Hl6c/00-00-18.jpg) ![Screenshot at 01:15: The speaker explicitly names the phenomenon being discussed: 'The Anointment Effect' being applied to the statistic.](https://ss.rapidrecap.app/screens/vtvwln8Hl6c/00-01-15.jpg) ![Screenshot at 03:35: The speaker begins detailing the specific analysis performed by Stuart on the source document, mentioning the 'convenience sample' issue.](https://ss.rapidrecap.app/screens/vtvwln8Hl6c/00-03-35.jpg) ![Screenshot at 07:44: The speaker questions why the claim was escalated to the level of an hour-long verification process, implying the initial data was weak.](https://ss.rapidrecap.app/screens/vtvwln8Hl6c/00-07-44.jpg)