AI Enterprise - Databricks & Glean | BG2 Guest Interview

Quick Overview

Databricks CEO Ali Ghodsi argues that the current AI landscape, despite massive capital spending, is experiencing a bubble because LLMs are becoming commoditized, emphasizing that true enterprise value and differentiation will come from proprietary, specialized data and engineering, not generic foundation models.

Key Points: Ali Ghodsi believes Large Language Models (LLMs) are becoming a commodity, similar to how one gets gas from any station, which leads to an AI bubble where much of the spending is misplaced. The differentiation for enterprises will be in the data they possess and the specialized engineering applied to it, rather than relying solely on generic foundation models. Ghodsi cites the high failure rate (95% of projects fail) and the need for deep, company-specific data understanding (like the Royal Bank of Canada example) to achieve real economic value. He contrasts the current situation with earlier tech cycles (Internet, Mobile, Cloud) where the core technology itself was the differentiator, whereas now the differentiator is proprietary data and specialized application layers. The second camp consists of the original creators of the technology (like the Turing Award winners), who are highly focused on fundamental advancements. The third camp focuses on building agents that can automate complex tasks, which is where the real future value lies, not just in probabilistic next-token prediction. The core advice for CIOs is to focus budgets on securing proprietary data and building specialized AI products on top of foundation models, rather than spending heavily on commoditized LLMs.

Context: The video features a panel discussion, titled "Guest Interview: State of Enterprise AI," involving Ali Ghodsi, CEO of Databricks, and Arvind Jain, CEO of Glean, moderated by Apoorv Agrawal of Altimeter Partner. The discussion centers on the current state of Artificial Intelligence adoption in the enterprise, particularly focusing on whether the hype surrounding LLMs constitutes a bubble and where true value creation resides in the AI stack.