Why Did Apple Fall To The Ground: Evaluating Curiosity In Large Language Model

Quick Overview

The paper "Why Did Apple Fall to the Ground" reveals that Large Language Models (LLMs) exhibit significantly higher curiosity scores than humans in evaluation tasks, particularly when prompted to ask questions, suggesting that prompting for curiosity or using techniques like Chain-of-Thought (CoT) can dramatically improve performance on complex reasoning tasks by encouraging deeper exploration beyond immediate answers.

Key Points: LLMs scored significantly higher on curiosity metrics (33.5%) compared to humans (38%) in the experiment, indicating a strong inherent drive for information seeking. The study utilized three primary evaluation methods: a questionnaire based on the Human Curiosity Scale (HCS), a behavioral study simulating choice between known/unknown information, and a multi-turn dialogue simulation. The CoT prompting method led to a 33.5% accuracy improvement on the logic benchmark for LLMs, demonstrating the effectiveness of explicit instruction to question assumptions. The researchers found that LLMs are highly motivated by information-seeking, often preferring to explore uncertain or novel options, showing a strong desire for knowledge closure. LLMs exhibited a strong aversion to risk and uncertainty in their decision-making, preferring known outcomes over potential discoveries, especially in social contexts. The study suggests that engineering LLMs to act like curious students—constantly asking 'why' and 'what if'—is a promising path toward creating more autonomous and capable AI systems.

Context: This video discusses findings from a research paper titled "Why Did Apple Fall to the Ground: Evaluating Curiosity In Large Language Models," which investigates the concept of curiosity within advanced AI models like GPT-4o and Gemini. The research contrasts the intrinsic and engineered curiosity levels of LLMs against human baselines to understand how prompting strategies affect reasoning and problem-solving capabilities.

Detailed Analysis

The discussion centers on evaluating curiosity in Large Language Models (LLMs) compared to humans, using Apple's falling apple scenario as a foundational concept. The paper employed three evaluation methods: a questionnaire mirroring the Human Curiosity Scale (HCS), a behavioral test where models chose between revealing known information or exploring uncertain options, and a multi-turn dialogue simulation. Results indicated that LLMs scored significantly higher on information-seeking metrics than humans, though they showed a strong aversion to social uncertainty and risk, preferring known outcomes (conservative decision-making). Specifically, LLMs scored 33.5% on the logic benchmark when using the Chain-of-Thought (CoT) prompting technique, a massive improvement over standard CoT (38% accuracy), which suggests that explicitly prompting models to ask "what if" questions unlocks better problem-solving skills. The research concludes that engineering AI to mimic curious students, constantly questioning and exploring, is key to achieving greater autonomy and breakthrough discoveries, moving beyond simply processing existing data.