Since as early as 2017, we've been seeing signs that Apple is working on possibly the next big thing in consumer tech – augmented reality (AR) glasses. Thanks to an increasing number of new Apple glasses leaks, rumors and even patents surfacing in recent months, we now know roughly what to expect from the upcoming wearable device.
You may have heard of VR (virtual reality) headsets, as they grew in popularity after 2012's launch of the Oculus Rift. They're usually large, bulky and expensive gaming-oriented devices that are designed to entirely block your eyes from seeing the real world. Because of that, they can be truly immersive for both gaming and professional tasks, such as pilot training. However, their bulk, immersion and reliance on a computer or a gaming console makes them unusable on the go, not to mention unfashionable.
However, AR (augmented reality) is different. AR glasses are see-through, as they use transparent lenses, and most simply add a digital overlay over your normal field of vision. For that to work, AR glasses can project a tiny screen on one or both of their lenses for the user to see. The design of AR glasses is also usually light and portable, similar to normal glasses, meaning they can be used outside.
Recent sources suggest that Apple is working on both AR glasses and a separate VR and AR headset.
Apple AR glasses price
$3,000
Although it's expected that Apple's first AR/VR headset will cost quite a pretty penny (allegedly around $3,000), reputable insiders are already saying that Apple is in development of cheaper models, possibly to come out in 2024.
Last year, analyst Ming-Chi Kuo shared his expectations for an Apple AR headset to be priced at around $1,000. Alternatively, a late September 2021 report coming from Digitimes suggested a price of $2,000, which is certainly more plausible.
Other reputable analysts and leakers, such as Bloomberg's Mark Gurman, are also claiming a high price of around $3,000.
The current consensus among some of the more reputable leakers, including Mark Gurman, is that Apple is going to unveil an AR/VR headset very soon, in March or April, 2023. Alternatively, the headset could be unvailed a month later in June, at WWDC.
Apple's smart AR glasses have been in development since at least early 2017. Around that time, Apple CEO Tim Cook shared his excitement for AR during an interview, calling it "huge", but also suggesting that the technology might not be ready yet "for the mainstream".
Over the years, Apple was granted several patents related to what are likely the Apple AR glasses, along with possibly a separate VR-like headset. In 2020, various rumors suggested a possible Apple glasses launch in 2021 or 2022, but so far, they all turned false.
Further along the line, a report by Kuo (from June 7th) said that Apple's AR headset has been delayed for Q2 of 2023, with an announcement event to happen in January of the same year, along with pre-orders opening soon after. He also says that the wearable will be out by WWDC 2023 (in June). Again, this is all to be taken with a grain of salt, since the device has already been delayed several times, and further delays are just as likely.
Apple AR glasses design
And Apple glasses concept art.
Apple Glasses concept by Martin Hajek for iDrop News
As is to be expected from Apple, its smart glasses will be as sleek and stylish as the technology inside would allow for. In May of 2020, leaker Jon Prosser said during a podcast that the Apple glasses would resemble traditional glasses, which is plausible. Their design would steer away from resembling "heavy machinery on your face" and will be targeted at regular consumers.
Apple glasses concept, courtesy of EverythingApplePro
Allegedly, in 2020 Apple had both black and white Apple AR glasses prototypes that were seen by the leaker. He also mentioned that prescription lenses will be supported by Apple glasses, which suggests that their lenses might be interchangeable.
Apple AR headset concept by AntonioDeRosa
Apple AR glasses displays
Like most augmented reality glasses, Apple's will sport either one or two tiny projectors in each frame, which would cast an image onto the lenses. The image would appear to the observer as an overlay to their environment.
If the Apple glasses can project into both lenses by employing two projectors, one for each lens, certain apps could easily feature 3D effects.
Apple Glasses concept by Martin Hajek for iDrop News
Back in 2019, a CNET report suggested that the Apple glasses would project in 8K, meaning an impressive 7680 x 4320 pixel resolution for each eye.
Apple HMD (head-mounted display) patent image from 2019
Ming-Chi Kuo has suggested that Apple will use Sony Micro-OLED displays and optical modules for a "see-through AR experience," but will also be capable of providing a "a VR experience".
Apple AR glasses speakers and microphones
Apple's AR glasses will likely sport at least two speakers, one in each frame and close to the user's ears.
This isn't unlike other modern smart glasses, for example the Amazon Echo Frames. Despite not having a display, those have four tiny speakers, two in each frame, in addition to a microphone. While wearing them, the user can interact with the Amazon Alexa smart assistant and hear feedback from it.
A February 25th patent filed by Apple revealed that the Apple glasses might employ a large array of microphones covering it. The patent in question has the microphones detect sounds, even those that are beyond human hearing, and suggests that some sort of indicators will be used for "directing the user to the source of the sound”. Like most Apple glasses-related patents, it's uncertain whether this one will have anything to do with the final product, or was related to an idea for a feature that is already scrapped.
Apple glasses patent image possibly showing the planned arrangement of its microphones
Apple AR glasses software
Leaked name: realityOS (dubbed ‘rOS’ internally)
What will I be able to do with the Apple glasses?
Apple’s first headset — likely to be released under the Reality brand — will cost around $3,000, include nascent technologies like pass-through cameras, in-air typing, hand and eye control and ultra-high-resolution displays. It will also have an external battery and main uses that may not immediately appeal to mass consumers.
At its core, the product will likely be more exciting to developer types than the regular consumer who is glued to their iPhone, iPad or Mac. It will take several years to shift the headset from a device that is interesting to technology fans to a product many Apple customers want. - Mark Gurman
The most recent leaks claim that Apple reportedly has two AR/VR platforms in the works - one based on iOS (rOS, a.k.a. reality Operating System) and the other on macOS (xrOS, a.k.a. Extended Reality Operating System). Clearly one of those AR devices will work solely with your iPhone, while the other - your MacBook; with Apple's AR glasses in particular likely to employ rOS.
In May of 2020, a leaker claimed that Apple's smart glasses will run on a new operating system or UI, codenamed "StarBoard". Back in late 2019, code that was discovered inside internal builds of iOS 13 did refer to codenames "StarBoard" and "STARTester". The latter was presumed to be an app which would detect whether Apple's AR glasses (also codenamed "T288") were being "worn" or "held." Along with that, the app was supposedly used to recreate what the wearer would see through the Apple glasses on an iPhone – likely for interface testing purposes.
Similarly to Amazon's Echo Frames smart glasses, Apple glasses users will be able to interact with a smart assistant (Siri in this case) by voice, ask it to call a contact, answer questions, make a note, play a podcast and so on.
Other Apple glasses features will likely include showing the wearer their iPhone notifications, displaying messages, map directions and other useful content. Like with Apple Watch, the Apple glasses would probably get their own app store, containing 3D AR games and other dedicated AR apps.
The Apple glasses will have 5G connectivity according to leaker Jon Prosser.
Apple AR glasses controls
Touch, voice, a ring, gloves? How will I interact with Apple glasses?
In mid-2019, an Apple application revealed that the company is working on magnetic sensing technology for detecting whether the user is wearing special gloves. In the patent, such gloves are shown to be used for interacting with the Apple glasses via gestures.
Image from an Apple patent showing the user interacting with AR glasses with a special glove and air gestures
Apple might also decide on a more discreet way of controlling the Apple glasses, like touch controls embedded in their frame or via a smart ring for touchless gesture controls.
Additionally, a future Apple Watch could be able to support air gestures, for interacting with Apple's AR glasses.
The latest rumors have also suggested using a digital crown (like the one on the Apple Watch) to navigate, or a pointing device worn on the user's finger. Those are all allegedly ways to navigate that were being tested by Apple, and we're yet to know for sure which input method the company would select for the final product.
Apple AR glasses camera
Will Apple's smart glasses have a camera? Or LiDAR?
Due to privacy reasons, it seems unlikely that Apple's smart AR glasses will have a built-in camera. One of the main criticisms towards Google's attempt at AR glasses (Google Glass) was that its built-in camera could be used to record people in public without their knowledge or consent. Because Google Glass had a built-in camera, wearing it was additionally banned in certain public areas, such as casinos and movie theaters.
Learning from this, most manufacturers of AR glasses don't include cameras anymore, nor would Apple, most likely.
However, analyst Ming-Chi Kuo expects an Apple AR headset to actually sport a whole 15 cameras, with eight of them used for AR video. As previously acknowledged, this could be a different device from the Apple VR glasses, that the Cupertino company is also working on. Apple Glass itself is still unlikely to have cameras and will focus just on AR, while the potential Apple VR headset is rumored to focus on both AR and VR.
Apple glasses LiDAR sensor concept, courtesy of EverythingApplePro
On the subject of cameras, Apple's LiDAR sensor, which we've seen on the iPad Pro and iPhone 12 Pro could make it into Apple's smart glasses. Taking in consideration that LiDAR isn't capable of capturing clear photos and videos of people like a standard camera, and will be useful for scanning the user's environment in order to enhance AR apps, Apple might be able to avoid potential privacy concerns despite including it.
Apple AR glasses battery and charging
Due to the size constraints of their design, Apple's glasses won't be able to employ large batteries, so the device will need to be energy efficient. A small battery cell would likely be integrated into each frame of the glasses.
Image from an Apple patent showing an AR headset charging in a docking station
Several Apple patent applications, which were published in March of 2020 suggested that Apple is considering its glasses to charge wirelessly on a dedicated dock. Judging by the most plausible patent, the glasses will contain magnets and coils that will connect with the dock, allowing for inductive charging.
FCC OKs Cingular\'s purchase of AT&T Wireless