why science is broken

Quick Overview

The video argues that science is "broken" due to a systemic issue where the incentives in academia and funding bodies reward producing more papers, regardless of their scientific merit or rigor, leading to a prevalence of "bad science" and "mathematical fiction."

Key Points: The academic system's incentive structure, which prioritizes the quantity of publications and grant funding, inadvertently promotes "bad science" and "mathematical fiction." Researchers are incentivized to publish more papers, even if they are flawed, to secure career advancement and funding, creating a cycle of "natural selection of bad science." This problem is not isolated to one field but is observed in psychology, sociology, and other scientific disciplines. The video references "Rigor Mortis" by Richard Harris and "How Economics Shapes Science" by Paula Stephan to illustrate how economic pressures distort scientific inquiry. The speaker argues that a lack of "self-correction" within the system means that researchers often fail to address or fix these issues, perpetuating the problem. The core issue lies in the incentive structure, which encourages researchers to pursue easily publishable or fundable topics rather than rigorous, potentially groundbreaking research. This systemic flaw leads to a decline in the quality and trustworthiness of scientific findings, ultimately hindering scientific progress.

Context: The video explores the concept of "bad science" and the systemic issues within academia that may contribute to its prevalence. It draws upon research and literature that critiques the current incentive structures, suggesting that the pressure to publish and secure funding can inadvertently lead to the production of scientifically unsound or speculative work. The speaker aims to explain why this phenomenon occurs and how it impacts the integrity and progress of scientific research.

Detailed Analysis

The video discusses the "natural selection of bad science," citing a 2016 paper by Smaldino and McElreath. The core argument is that the academic and funding system incentivizes quantity over quality, leading researchers to prioritize publishing more papers, even if they are based on flawed methodologies or "mathematical fiction," to secure grants and tenure. This creates a cycle where "bad science" proliferates because the system rewards it. The speaker highlights that this problem is not new, with similar issues observed in fields like psychology and sociology, where flawed statistical methods and a focus on results that gain attention are prevalent. The video suggests that the current incentive structure, which emphasizes metrics like publication count and citations, discourages rigorous, slow, and potentially groundbreaking research. The speaker references books like "Rigor Mortis" by Richard Harris and "How Economics Shapes Science" by Paula Stephan to illustrate how economic pressures and flawed incentive structures can distort scientific inquiry, leading to a situation where researchers are incentivized to "cut corners" rather than pursue genuine scientific advancement. The video concludes by emphasizing the need to fix this broken system and foster an environment that rewards true scientific rigor and meaningful discovery.