Apple’s Camera Chief Says AI Unlocks Superpowers
▼ Summary
– Apple is adding generative AI features to its Photos app, including Extend and Spatial Reframe, which generate fake pixels to expand or change an image’s perspective.
– Apple’s iPhone camera chief, Jon McCormack, says the company is taking a measured approach to AI, focusing on deliberate tools rather than “AI for the sake of AI.”
– The new AI features are restricted to altering backgrounds only; they cannot remove the primary subject or modify the main subject’s face.
– Apple plans to integrate Google DeepMind’s SynthID technology to add invisible watermarks indicating AI editing, though digital watermarks are not foolproof.
– McCormack emphasizes that Apple’s tools aim to preserve the authenticity of photographs as records of real moments, supporting “authentic journalism to your own life.”
What defines a photograph in today’s digital age? As major tech companies integrate generative AI into smartphones and their camera software, the boundary between authentic images and artificially altered ones grows increasingly hazy. Devices from Google and Samsung already offer features that allow users to erase, reposition, or even insert new objects into a scene with a few taps.
Apple is now joining this wave by introducing its own generative AI tools within the Photos app. However, Jon McCormack, Apple’s head of iPhone camera software, emphasizes that the company is adopting a more deliberate strategy compared to its rivals. “We’re not doing AI for the sake of AI,” he explains.
During its annual Worldwide Developers Conference on Monday, Apple unveiled several AI-driven enhancements for the Photos app in iOS 27, set to launch later this year. The existing Clean Up tool, which removes unwanted objects from images, will become more powerful thanks to improved AI models. But the standout additions are two new features: Extend and Spatial Reframe. Extend lets users expand the canvas around a photo, while Spatial Reframe adjusts the image’s perspective,both by generating synthetic pixels. The camera essentially “thinks” about what should fill the new space and draws it in.
McCormack notes that AI is finally solving a long list of previously intractable problems, and these features are designed with clear intent. “You don’t have to know all the details of how to do something in Photoshop or something else,it gives normal people these absolute superpowers,” he says.
Despite these capabilities, Apple is cautious about enabling unfettered image manipulation within the Photos app. The generated pixels are limited to background areas only; the main subject’s face remains untouched. For instance, Clean Up cannot remove the primary subject from a photo. The Extend feature works just once, expanding the image by 25 percent, and users cannot save, re-edit, and repeatedly extend the same image with AI.
McCormack also revealed that Apple will integrate Google DeepMind’s SynthID technology later this year to embed an invisible watermark on AI-altered images. This watermark could allow platforms where the photo is shared to flag it as AI-edited, though researchers caution that digital watermarks are not infallible.
“A photograph is of something that actually happened,” McCormack states. “We really do believe in this idea of authentic journalism to your own life,when you’re capturing photographs, you’re making these memories, you’re putting moments of your life in a bottle that you can go back to. It’s really important to us that we create tools that keep the sanctity of that moment.”
(Source: Wired)
