The Apple Watch Has a Problem | Marques Brownlee

The Gist

The Apple Watch Series 12 and Ultra 4 introduce Audio Intelligence features, specifically Siri Recap and Live Rewind, which constantly process raw microphone audio through the secure enclave and trigger privacy and surveillance concerns.

Quick Overview

Apple's newest smartwatches capture and process ambient audio continuously through a dedicated hardware secure enclave to power advanced transcription and recap features. While Apple emphasizes end-to-end encryption and claims raw audio is not stored, the passive recording capabilities of these devices create significant privacy implications for everyone nearby.

Key Points: The market for screenless fitness bands grew by 122 percent in a single year, pushed forward by Whoop and competitors like Fitbit Air and Garmin Forerunner. Apple redesigned the sensor array on the Apple Watch Series 12 with larger, more powerful LEDs and photodiodes to read background heart rate every 5 seconds instead of every 5 minutes. Apple Health has added a longevity section that provides a health age score based on sleep scores, readiness scores, and advanced lab uploads. Apple's four new audio intelligence features include sound recognition, music recognition, live rewind, and siri recap. Siri recap uses ambient listening to take high-level notes of your conversations all day and saves them in the Siri app. Live rewind lets users double-tap the digital crown to retrieve an encrypted transcript of the last 15 seconds of audio. The S11 chip houses a secure enclave that processes raw audio locally using machine learning algorithms for pattern recognition without storing the actual audio. OpenAI previously poached Apple employees and partnered with Jony Ive to build a portable AI companion device, fueling direct hardware competition.

Context: Apple announced the Apple Watch Series 12 and Apple Watch Ultra 4 alongside heavy competition in both the fitness tracker market led by Whoop and the emerging AI hardware space where companies like OpenAI are designing screenless AI companions.