We’re Doing AI All Wrong. Here’s How to Get It Right | Sasha Luccioni | TED

Quick Overview

Sasha Luccioni argues that the current trajectory of developing increasingly large AI models (LLMs) is unsustainable due to massive energy consumption, advocating instead for prioritizing smaller, more efficient, and task-specific models, as demonstrated by the AI Energy Score project, which shows that smaller models can achieve similar performance with vastly lower energy footprints.

Key Points: Large Language Models (LLMs) are consuming immense capital (hundreds of billions of dollars) and energy, setting a precedent where only a few big AI companies can afford to build and deploy them. The energy cost of training state-of-the-art LLMs is unsustainable; for example, training GPT-4 costs around $30 million to $40 million, equivalent to the annual energy use of the entire country of Iceland. The speaker advocates for shifting focus from the 'bigger is better' mentality to models that are smaller, cheaper to train, and more energy-efficient, citing models like Hugging Face’s SmolLM-135M (7.28 Wh per 1k tasks) compared to DeepSeek R1 (1039.24 Wh per 1k tasks) for text generation. The AI Energy Score project assigns scores from 1 to 5 stars based on energy efficiency across various AI tasks, like text generation and image processing, to promote transparency and better choices. Smaller, task-specific models can perform many tasks comparably to massive LLMs while running locally on devices like phones, drastically reducing reliance on massive data centers. Environmental applications, like Forest Protection Connection using AI for acoustic monitoring of illegal logging, demonstrate that smaller, specialized AI can provide significant societal benefits without massive energy demands.

Context: Sasha Luccioni presents her argument at a TED Countdown event, focusing on the hidden environmental and economic costs associated with the current trend of building ever-larger Large Language Models (LLMs). She challenges the industry narrative that bigger AI is inherently better, contrasting the massive resource requirements of models like GPT-4 and Gemini 1.0 Ultra with the potential of smaller, more specialized models to address critical global issues like climate change more sustainably.