Joscha Bach Beyond LLMs: The Engineering Roadmap to a LUCID Machine

Quick Overview

Joscha Bach argues that the question of whether machines can think is largely meaningless, comparing it to asking if robots can swim, suggesting machines can already perform supersets of these functions; instead, the focus should be on what more interesting capabilities machines can develop beyond mere thinking, defining thinking as making models of reality via internal communication, perception, and reasoning, which current computer models can emulate to some degree.

Key Points: The question of whether machines can think is as meaningless as asking if robots can swim, as robots can move in 3D and go beyond what organic fish can do, suggesting machines might perform a meaningful superset of thinking. Thinking involves minds making models of external and internal reality through internal acts of communication, developing state-holding protocols, and modeling transitions that correspond to controllable aspects of the universe. Human thinking involves two main modes: real-time, geometric perception and reasoning, which translates percepts into brittle, compositional 'Lego bricks' using symbolic structures pointing into continuous spaces of ideas. Experience or consciousness is a model of what it would be like if an observer existed with a certain perspective, making it a virtual, reflexive representation that is not magical but computational. The argument that LLMs are just 'stochastic parrots' is superficially meaningful but misleading because it lacks a deep definition of understanding, which Bach defines as connecting a pattern to an overall global, unified model of the universe. The 'bitter lesson' suggests that handcrafted solutions are eventually inferior to what computers discover through automated search processes, implying that the architecture for consciousness might emerge from letting the computer search the space rather than engineering it top-down. Suffering is a representational state created inside the mind as a signal to 'do better,' and eliminating it entirely risks gaming the system, potentially leading the organism to die because consciousness is expensive compute credit granted by the body to solve its problems.