Apple is introducing new AI features to its watches that process live audio and transcribe speech in real time. This move happens at the company’s “Surprise and Shine” iPhone event, where the foldable iPhone was shown but the real attention went to the privacy-sensitive giant allowing its watches to listen and transcribe what is said.
Wearing an Apple Watch does not mean you are being recorded constantly, though the change may make some people uncomfortable. It also raises the question of whether consumers actually want this technology or if Apple pushed ahead because it feared a competitor like OpenAI would launch a similar device first.
Several startups are already treating AI-powered transcription as a key use case. These companies focus on meeting notes, lectures, and interviews. Some, like the AI pendant Friend and Amazon’s Bee, have ventured into always-available AI companions that passively take notes to help users remember their day.
Apple chose a different route. Its new watches offer “audio intelligence,” “Live Rewind,” and “Siri Recap,” straddling the line between accessibility and utility on one side and what feels like invasive technology on the other.
Audio Intelligence
Audio Intelligence acts as a useful feature for the deaf or hard of hearing. It alerts owners to sounds like sirens, alarms, doorbells, and crying babies using on-device AI. This works even when the wearer’s iPhone is not nearby. In some cases, it could provide life-saving assistance, such as when a fire alarm or carbon monoxide detector goes off. It is doubtful anyone would take issue with this type of audio AI.
However, Live Rewind and Siri Recap move out of the assistive tech space and into a murkier area.
Live Rewind
The Live Rewind AI feature lets you go back 15 seconds and transcribe what was just said by double-pressing the watch’s digital crown. This transcription can be saved to Apple’s new standalone Siri app so you can revisit the information later.
Apple suggests this could be used to remember things like a book recommendation, a colleague’s brilliant idea, or something you did not hear the first time. It also means you can essentially catch anyone saying something they did not necessarily mean to have recorded and make a note of it.
This has implications around consent, not only from an ethical standpoint but from a legal one as well. AI device-maker Plaud advises customers to obtain legally required consent before recording. Amazon’s Bee terms of service remind users that they are solely responsible for complying with the law around minors’ data privacy, not Amazon.
Since Apple is not saving audio, it is unclear how the court system might handle these new, text-only transcripts. It is possible the notes could be introduced as evidence in court, but their lack of audio could make them harder to authenticate or verify. Plus, the evidentiary rules around their use will also likely vary by state.
Cultural impact
Beyond the legal issues, the idea that someone can always record from their watch has cultural implications. Recording devices have already impacted the way people behave in real life, as studies have shown, along with social media and data surveillance culture. Knowing you could be recorded at any time has a dampening effect on how you interact with others and engage in self-expression.
However, recording a photo or video still requires a fairly obvious move on the recorder’s part: you have to hold up your phone and face it toward the action. Snapping up a bit of audio to turn into a transcript just by pressing the watch’s digital crown is arguably a much subtler gesture, even though it comes with an audible chime and full-screen animation of a microphone, as Apple says.
Siri Recap
Another new Apple Watch feature, “Siri Recap,” uses ambient listening to “take high-level notes” of your conversations, which can be reviewed in the Siri iOS app. These notes will automatically generate a title, summary, and key points based on what was recorded and summarized by AI. They will not be exact transcripts.
Apple suggests this could make sense for recording meeting takeaways or key info from a parent-teacher conference, for instance.
Privacy claims
The company also tried to assure users that it has approached these listening features with respect for user privacy.
Apple notes that Siri Recap does not default to always being on like some other AI wearables are. Instead, you can choose when it is enabled, like only at work or only during the day. Plus, you can turn the feature off and on at any time from Control Center.
Notably, Apple points out that it does not create or store audio recordings, and that the raw audio is not accessible, even to Apple. It also does not identify or attribute the speakers, and it protects the generated transcripts and recaps with end-to-end encryption.
Whether that is enough for consumers not to feel like the feature is creepy is another matter. Either Apple has found the right balance between utility and privacy, or it is about to see some consumer backlash.
What it means
For people making things, the shift means a new layer of friction in daily interaction. You can now capture a conversation with a double-tap, but the act of recording is less visible than holding up a phone. This subtlety changes the dynamic of consent, making it harder to know if someone is being captured in the moment. The legal and ethical weight of creating text notes from speech without audio files remains an open question for users and courts alike.
