Gemini Exponential, Demis Hassabis' ‘Proto-AGI’ coming, but …

Quick Overview

The exponential growth in AI compute spending, projected to consume half of OpenAI's revenue by 2028, is the single biggest blocker to achieving Artificial General Intelligence (AGI), according to Shane Legg, co-founder of Google DeepMind, who advocates for efficient algorithm development rather than just pure scaling to mitigate this trend.

Key Points: Shane Legg, Google DeepMind co-founder, stated that the exponential growth in compute costs is the biggest blocker to achieving AGI. OpenAI's projected compute spending could reach half of its revenue by 2028, a trend he suggests is unsustainable without major breakthroughs. Legg cited his 2019 prediction of AGI by 2029, noting that the current pace of scaling is outpacing his initial timeline. He advocated for focusing on algorithm innovation (like finding better ways to simulate physics or math) rather than simply scaling models. The release of Gemini 3 Flash demonstrates that smaller, faster models can achieve performance comparable to larger models, suggesting efficiency gains are possible. The video referenced external reports, including one from The Information regarding specialized data sales and another from Reuters about compute crunch, illustrating the competitive landscape and cost pressures. The discussion highlighted that while models like GPT-5.2 are improving, the underlying compute demands remain a critical constraint.

Context: This content is derived from an interview on the Big Technology Podcast featuring Shane Legg, co-founder of Google DeepMind, discussing the state of AI development, particularly concerning the exponential growth in compute resources required for training large language models (LLMs) and the timeline for achieving Artificial General Intelligence (AGI). The discussion contrasts the pure scaling approach with the need for algorithmic efficiency, referencing recent model releases like Gemini 3 and the competitive dynamics between major AI labs.

Detailed Analysis

The discussion focuses on the primary bottleneck to achieving AGI: the exponential growth in compute costs. Shane Legg, co-founder of Google DeepMind, projects that OpenAI's compute spending will consume half of its revenue by 2028, a trajectory he deems unsustainable without fundamental shifts. He referenced his 2019 prediction of AGI by 2029, noting that recent model releases, such as Gemini 3, are accelerating progress faster than anticipated, but the underlying resource demands are the main constraint. Legg argued against relying solely on scaling, suggesting that advancements in algorithms—like those that allow models to better simulate physics or math—are crucial. He pointed to Gemini 3 Flash as an example of efficiency, achieving high performance at a lower cost than its larger counterparts. The conversation also touched upon external factors, like data scarcity (referencing a tweet about companies refusing to sell proprietary data to OpenAI/Anthropic) and the competitive landscape where Google is trying to keep pace with competitors like OpenAI and Anthropic, particularly in areas like image generation with models like Veo 3.1 and Nano Banana Pro. The overall theme suggests that the future of AI advancement hinges not just on throwing more compute at the problem, but on finding smarter, more efficient algorithmic solutions.