AI Obsession And The Coming Storm | An Interview With Robert Wright

Quick Overview

Robert Wright argues that the current "AI race" mentality, particularly between the US and China, is a dangerous misdirection, advocating instead for a slower, internationally collaborative approach to AI development to mitigate existential risks and societal disruptions, while acknowledging the potential for AI to bring about radical abundance and scientific breakthroughs if managed carefully.

Key Points: Robert Wright believes the current "AI race" mentality, especially between the US and China, is a "really bad motto" and advocates for "slower is better" and international collaboration to manage AI's immense social impact. Wright is concerned about AI's potential for "earthquake"-level social impact, affecting jobs and human life, and does not rule out hardcore doomer scenarios like AI takeover, though he finds them hard to eliminate as a possibility. He views AI development as analogous to evolution due to emergent properties, stating, "we don't really know exactly how they're hooked up" and "we don't really think nearly as carefully about it as we need to be thinking." Wright questions the sincerity of AI leaders like Sam Altman and Dario Amade, suggesting their pronouncements on existential threats might be a way to avoid regulation or attract investment, and criticizes Amade's logic on gaining safety through US dominance over China. He finds "successionist" ideologies in Silicon Valley, where some believe humanity should cede to AI, concerning, and notes figures like Peter Thiel have views that "alarm me," including being "very anti-international governance." Wright suggests that US chip export controls on Taiwan actually reduce China's disincentive to invade Taiwan, as they are denied access to critical technology produced there. Despite the risks, Wright acknowledges AI's potential for radical abundance, medical and scientific breakthroughs, and even aiding in world peace by overcoming cognitive biases, but stresses that achieving these positive outcomes requires careful, deliberate progress, not a "full speed ahead" approach.