How Classical Thinking Shaped Modern AI | Peter Danenberg | TEDxBoston

Quick Overview

The speaker argues that the rapid advancements in AI, particularly Large Language Models (LLMs) like those from Google, are largely due to an accelerationist mindset rooted in classical thinking, drawing a parallel to the hypothetical scenario of sending modern AI knowledge back to the 1970s, which would have dramatically accelerated progress compared to the slow, incremental development seen historically.

Key Points: The speaker attributes the rapid progress in modern AI, especially LLMs, to an underlying accelerationist philosophy derived from classical thinking. He references the concept of sending knowledge about modern AI (like LLMs) back to the 1970s, suggesting progress would have been much faster than the historical timeline. The speaker notes that Google's early approach to AI was perceived as 'weird' because they prioritized pushing boundaries, which he views as positive, even if it led to PR issues like the initial chatbot issues (e.g., Bard's early performance). He contrasts current LLMs with previous models like LSTMs, suggesting that the new architecture (Transformers) is not inherently a step function change but rather a scaling issue, though he admits this is debatable. The speaker mentions that he is currently working on 'Ambiant LLM' and suggests that if the current rapid pace continues, we might need new thinking rather than just scaling existing models to avoid a 'creepy' outcome. The discussion concludes with a hypothetical question: if you sent modern AI knowledge back 40 years, would we have achieved AGI sooner, suggesting that the acceleration is the key factor, not necessarily a single architectural breakthrough.

Context: This segment is part of a TEDxBoston talk featuring Peter Danenberg, who discusses the role of classical philosophical thinking and an 'accelerationist' mindset in driving modern advancements in Artificial Intelligence, specifically Large Language Models (LLMs). The conversation involves an unnamed interviewer (John) who prompts Danenberg to reflect on his past experiences at Google and the trajectory of AI development relative to historical progress.