Post-AGI Elites?

Quick Overview

The collapse of competence hierarchy due to Artificial General Intelligence (AGI) will shift power from elites defined by management of complexity to a new elite defined by liability and moral authority, illustrated by the transition from feudal/industrial hierarchies (lineage/wealth) to meritocratic ones (competence/IQ) and finally to a post-AGI future based on liability and willingness to bear consequences, which is visualized as the 'Terminal Reservoir' where accountability replaces expertise as the primary scarce resource.

Key Points: The traditional basis for elite status, competence in managing complexity (meritocracy), is collapsing because AGI commoditizes high-level strategy and logistics, making superintelligence cheap and abundant. The new basis for elite status in a post-AGI world will be liability/accountability, meaning those willing to bear the consequences of decisions will hold power, exemplified by the concept of the 'Terminal Reservoir'. Historical hierarchies evolved from lineage/wealth (Feudal/Industrial) to competence/IQ (Present/Meritocratic), and the future (Post-AGI) hierarchy will be based on liability and function as a 'Moral Crumple Zone'. The speaker references the concept of 'Intelligence Arbitrage' collapsing, where the value of raw intelligence or strategic competence rapidly declines. The speaker introduces the idea of 'AGI-Augmented Sortition' as a solution, combining AGI's simulation capabilities with randomly selected citizen juries to review values and ethics before voting. The concept of 'The Persistence of Gravity' in networks explains why even flat structures naturally form hubs (Super-Nodes) due to preferential attachment, leading to inequality. The ultimate function for humans in this new world is having the 'Right to be Wrong'—the veto power over AGI plans that violate human values, as AGI cannot truly value survival or bear consequences.

Context: This video discusses the profound societal and structural shifts predicted after the advent of Artificial General Intelligence (AGI), focusing on how the traditional sources of elite power (competence and management of complexity) will evaporate. The speaker outlines an evolution of hierarchy structures, contrasting the past (feudal/industrial), the present (meritocratic), and the predicted future (post-AGI), where liability and accountability become the scarce resources that define new elites. The discussion draws parallels from political theory, referencing Rousseau's 'General Will' and the inherent difficulty of holding non-corporeal entities like AI accountable.