Apple Watch Live Rewind Raises Privacy Questions as Apple Details Secure Enclave Safeguards

According to TechRadar, Live Rewind is available on Apple Watch Series 12 and Apple Watch Ultra 4. Apple says it is meant for people who miss something important, are deaf or hard of hearing, or want to recall a tip or recommendation from a friend. When a user double-presses the Digital Crown, the Watch provides a text transcript of the previous 15 seconds of audio.

Some observers initially worried that the tool would allow surreptitious recording of others without their knowledge, and then permit those recordings to be saved for harmful purposes. Social media users were divided. Some called the feature 'creepy and antisocial,' while others pointed out how it could be useful for deaf people or those with autism.

Apple has said Live Rewind never records or stores audio, does not identify anyone's voice, and cannot be accessed by anyone, including Apple. To explain the mechanics, Apple published an Audio Intelligence Privacy Overview covering Live Rewind and other new Audio Intelligence tools, including Siri Recap. In the case of Live Rewind, audio is processed in the Secure Enclave, a separate part of the S11 chip. The Secure Enclave is isolated from the rest of the device, and no part of the operating system can access it or the raw audio it handles. That restriction applies to first- and third-party apps, and Apple says even it cannot reach anything in the Secure Enclave.

The privacy paper says audio is never saved or recorded during Live Rewind. Instead, the Secure Enclave processes the audio to generate a transcript, and the audio is then permanently deleted from both the device and iCloud. According to Apple, no one can listen to the audio later or extract it from the device. Audio enters the Secure Enclave on a rolling basis, so older data is continuously overwritten and deleted as new audio arrives.

When a user activates Live Rewind, the feature tries to send the last 15 seconds of audio to the user's iPhone. If it cannot, for example because the iPhone is not within wireless range, the audio is immediately discarded. If the transfer succeeds, the audio is converted to text on the iPhone, deleted, and the text is sent back to the Secure Enclave in the Apple Watch. The saved text remains available on the Watch for 30 seconds after the screen dims, after which it is discarded. Users can optionally save the text to the Siri app, where it is end-to-end encrypted. Apple says this is the only instance in which something is saved during the Live Rewind process, and the text does not contain any speaker attribution.

If a user asks Siri about transcripts, the text is sent to Apple's Private Cloud Compute servers. If the user has iCloud with two-factor authentication and has secured the device with a passcode, any Live Rewind transcripts are synced using end-to-end encryption, and Apple says it cannot decrypt them.

Apple also says Live Rewind cannot be used without those nearby knowing. When the Digital Crown is double-pressed, the Apple Watch plays an audible chime even if the device is in silent mode or the user is listening through headphones. A full-screen animation also plays, and the microphone icon is displayed. Through sound and visuals, the Watch tries to alert other people about what is happening. Live Rewind is opt-in rather than opt-out, and users can enable it when setting up a new device. It can also be turned on or off in Siri Settings on the Apple Watch or in the Siri Settings section of the Apple Watch app on the iPhone. Although Apple says it would be polite to ask permission before using the feature, there is no way for the company to force a user to do so.

Editor's Summary

Live Rewind gives Apple Watch Series 12 and Ultra 4 users a text transcript of the last 15 seconds of audio, but the feature has raised privacy concerns about secret recording. Apple says the audio is processed in the Secure Enclave, never stored, and optionally saved only as end-to-end encrypted text in the Siri app. The feature includes audible and visual alerts and is opt-in, though Apple cannot force users to ask others for permission.