Mustafa Suleyman: The AGI Race Is Fake, Building Safe Superintelligence & the $1M Agentic Economy

Quick Overview

Mustafa Suleyman asserts that the idea of winning the AGI race is a flawed metaphor because technology proliferation is simultaneous and not zero-sum, emphasizing Microsoft's focus is transitioning from operating systems to agents and companions while prioritizing building the safest superintelligence.

Key Points: Suleyman rejects the AGI race metaphor, stating, "I'm not sure there's a race," because technology proliferates simultaneously across all scales, implying it is not zero-sum. Microsoft's fundamental transition is moving "from a world of operating systems, search engines, apps, and browsers to a world of agents and companions" that act as 24/7 assistants. Suleyman proposed the 'modern Turing test' as an economic benchmark, suggesting measuring the first model that makes "a million dollars" from $100,000 in starting capital (a 10x return on investment). He believes the Turing Test has already been passed, noting the current focus should be on agentic actions, which he predicts will be very good in the next couple of years, potentially passing the economic test by 2027. Suleyman admits he incorrectly predicted that large companies would not open source models, stating, "I got that totally wrong," referencing how Llama undermined the cost base Inflection AI was built upon. Safety and alignment are paramount; Suleyman stresses, "it is super urgent that right now we have to declare what kind of super intelligence are we going to build and are we actually going to countenance creating some entity which we provably can't align." He views AI legal personhood as "extremely not on the table" because AI's infinite replicability and potential superiority to biological life creates an inherent, dangerous competition for resources.

Context: The discussion features Mustafa Suleyman, co-founder of DeepMind and Inflection AI, now CEO of Microsoft AI, being interviewed about the state and trajectory of artificial intelligence development, particularly within the context of Microsoft's vast resources and long-term vision. The conversation revisits Suleyman's past work, including the early days of DeepMind and the surprising acceleration of AI capabilities, contrasting the slow grind of early deep learning research with the current exponential progress seen in large language models (LLMs).