Apple Inc has reached the late stages of development for new AirPods with built-in cameras, a significant milestone for what will likely be its first wearable device designed for the artificial intelligence era.
The project has entered a phase where prototypes feature a near-final design and capabilities, according to people with knowledge of the matter. The earbuds, which rely on cameras to see the space surrounding a user and provide information, are in advanced testing, said the people, who asked not to be identified because the work is still under wraps.
Apple is betting that the new device can capitalise on the success of AirPods while also vaulting it into AI-enhanced hardware – an area where it’s facing competition from OpenAI, Meta Platforms Inc and others.
The cameras essentially act as eyes for the Siri digital assistant and aren’t designed to take photos or video. These components – located in both the right and left earbuds – allow the device to capture visual information in low resolution. Other than longer stems to accommodate the cameras, the product will resemble the AirPods Pro 3.
Apple had planned for the earbuds to go on sale as early as the first half of this year, but the launch was postponed after delays to a revamped version of Siri. The new Siri is now on track for September after Apple upgraded its underlying models using Alphabet Inc’s Gemini technology.
Testers inside Apple are actively using prototypes of the new AirPods that are at a stage known as DVT, or design validation testing. That’s the final major development stage before PVT, or production validation test, which involves making early mass-production units.
While the hardware is nearly ready, concerns about the AI elements could further hold back a launch if Apple isn’t pleased with the quality of the visual intelligence features, the people said. A spokesperson for Cupertino, California-based Apple declined to comment.
The idea is to let users ask questions about an item they might be looking at. For instance, they could be facing food ingredients and ask what they should cook for dinner. It’s a similar experience to what someone gets from uploading photos in AI services like OpenAI’s ChatGPT or the iPhone’s own Visual Intelligence function.
Apple has also been working on other uses for the AI cameras. The device could give the wearer a reminder based on something the camera sees, or it might use external visuals to provide more advanced turn-by-turn directions. The AI could cite a specific landmark ahead when telling users when they should turn.
Apple also aims to address privacy concerns from people who don’t want to be filmed by gadgets – an issue for smart glasses as well. The company has built a small LED light into the earbuds that will turn on when visual data is being fed into the cloud. Given the small size of earbuds, it’s unclear how visible the light actually will be.
The new AirPods have been in development for around four years and will be part of a wave of AI products. The company has also been working on smart glasses and a pendant with cameras for as early as next year, but development of both of those products trails the AirPods.
Apple is expecting strong demand for the new AirPods and has operations teams working to secure enough components for a launch. That’s a particularly challenging task at the moment due to industrywide shortages related to memory chips and other silicon.
Unlike the Apple Vision Pro headset, another device with a slew of external sensors, the new AirPods aren’t designed to support hand-gesture control. The upcoming Apple glasses also aren’t currently slated to offer this capability, according to people familiar with the products.
John Ternus, Apple’s incoming chief executive officer, has been touting a strong product pipeline during employee events in recent weeks, saying that the company is on track to upend the industry in a similar way to what happened with the iPhone, iPad and iPod.
"We are about to change the world once again,” Ternus told employees after he was named as the next Apple CEO. "If you’re lucky, and I mean really lucky, you can have a moment or two in your career to be part of something profoundly important. Now we’re in a moment where we get to do it again.”
Ternus is overseeing the development of roughly 10 major new products, a list that includes a touch-screen MacBook, foldable iPhone and AI-powered smart home devices. He replaces Tim Cook as CEO on September 1 and will lead the company’s big annual launch event that month.
Apple has been looking to upgrade the visual AI capabilities of the iPhone as well. It’s planning a new Siri camera mode in iOS 27 that will make the visual AI features more prominent in the iPhone’s operating system. The change should expose more users to the concept of feeding visual data into AI services.
Apple is racing to compete with OpenAI, Meta and others in the burgeoning AI device space. OpenAI has been pillaging Apple’s hardware engineering ranks for talent to work on competitors to Apple’s smart home and mobile devices, while Meta is revamping its own AI wearables.
Bloomberg News first reported in February 2024 that Apple was developing AirPods with built-in cameras. The company has also worked on an Apple Watch with a camera but cancelled that project last year.
The AirPods are a strong place for Apple to start implementing AI, given the pervasiveness of the earbuds. Customers frequently purchase them alongside iPhones, Apple’s flagship product.
The AirPods have been a hit for Apple since first launching in 2016. The company last rolled out new earbuds at the end of last year, adding a heart-rate monitor akin to the one in the Apple Watch. It updated its over-ear headphones, the AirPods Max, in March. – Bloomberg
