Harvard Law School Library Book Talk | Cass Sunstein, ‘Imperfect Oracle: What AI Can and Cannot Do’

Quick Overview

Cass Sunstein argues that while AI algorithms can be less biased and noisy than human judgment in some areas like predicting coronary events or recidivism, they fail in domains involving complex social interactions, context, and human preferences, as illustrated by the failures in predicting song success and the need for human intuition in bail decisions.

Key Points: Human judgment is inherently biased and noisy, which AI can sometimes correct, as shown in predicting coronary events where AI outperformed human doctors (08:06). AI algorithms, however, fail in predicting outcomes sensitive to social dynamics, context, and individual preferences, such as the success of songs or bail decisions (09:59, 10:41). The failure in predicting song success (The Music Lab experiment) demonstrated that algorithms struggled with unpredictable elements like social interactions and individual preferences (02:53, 03:10). In bail decisions, algorithms often overweigh current offense bias and mugshot bias, while human judges are noisy, leading to complex trade-offs (10:25). John Rawls' concept of uncertainty is relevant: some predictions (like war or copper prices 20 years hence) lack a scientific basis for calculable probability (03:04, 03:28). The inherent unpredictability in human affairs—like romantic attraction—means that purely data-driven AI approaches will struggle where context, timing, serendipity, or mood are key factors (07:33, 08:09). The speaker concludes that while AI excels in certain structured domains, human intuition and judgment remain critical for navigating complex, unpredictable human social systems (04:28, 05:03).

Context: This video captures a book talk at the Harvard Law School Library featuring Cass Sunstein discussing his book, 'Imperfect Oracle: What AI Can and Cannot Do.' Sunstein contrasts the capabilities of AI in predictable domains, such as medical diagnosis, with its limitations in areas governed by complex human behavior, social dynamics, and inherent uncertainty, drawing on examples from criminal justice and cultural trends.