Apple's rumored mixed-reality headset could use gloves as a controller

Apple's rumored mixed-reality headset could use gloves as a controller
By now, many of you know that Apple's next big thing is NOT going to be the HomePod. Actually, for a few years now, analysts have been expecting Apple to introduce AR glasses as soon as 2020-2021. There have been two schools of thought here; one is that this will be a standalone device while others, including reliable TF International analyst Ming-Chi Kuo, expect your iPhone to carry the brains of the headset. Kuo, in fact, says that production on the Apple Glasses will start no later than the second quarter of next year.

A couple of patent applications filed by Apple reveals a pair of features that the company is apparently working on for the headset which has been dubbed Apple Glasses. The patent applications (1,2) were submitted with the U.S. Patent and Trademark Office (USPTO) in February. The first one, titled Scanning Mirror Display Devices, discusses technology that uses lasers and mirrors to project images directly into the eyes of the person wearing the glasses in lieu of a display. This could be done in a way to support Augmented Reality (AR) by allowing the images to be overlayed over a real-world view. The patent application says that this technology might be used to replace "overly complex, bulky, and uncomfortable to wear" head-mounted displays.

Apple's mixed-reality headset could launch as soon as next year


The second patent application, Magnetic Sensor Based Proximity Sensing, uses magnetic sensing technology to detect the position of a user wearing a special glove on his or her hand. This could be used to control VR or AR features on the Apple Glasses through the use of hand gestures. A person wearing the headset would also don the gloves which have special material on the fingertips.


Last month, a report stated that Apple had decided to terminate the Apple Glasses project, but that might not have been the case based on subsequent reports. In fact, just 10 days after that story made the rounds, a huge leak revealed that the tech giant was working on a mixed-reality headset supporting both AR and VR. The glasses will supposedly offer 8K resolution of  7680×4320 for each eye. The device has a codename of T288, according to this leak, and uses a newly developed operating system called rOS for reality Operating System. A 5nm chip will reportedly power the glasses and TSMC is expected to start producing components using this process starting next year.


The same report said that Apple's headset would also include eyebrow and jaw sensors to determine the expression being made by the user, hand sensors (which might include the technology found in the second patent that we discussed in this article), sensors to track the eyes and left and right cameras. Many of these features were also discovered in a patent that Apple filed with the USPTO this past March.

Back in June of 2017, analyst Gene Munster, now with Loup Ventures, said that the Apple Glasses would end up being bigger than the iPhone. At the time, Munster said, "In 10 years we expect the iPhone will be around, but be a much smaller part of Apple's business as Apple Glasses slowly gains market adoption." The analyst originally expected the glasses to launch in 2020, but changed that forecast to December 2021 back in May. Munster forecasts that 10 million Apple Glasses will be rung up during the device's first year on the market.

FEATURED VIDEO

6 Comments

5. afrohoxha

Posts: 254; Member since: Mar 13, 2014

Waiting for Adrian to write an article with words like "This device needs to be put down. Canceled. Nixed. Killed with fire."

10. audibot

Posts: 634; Member since: Jan 26, 2017

kind of like my leap motion that does it by traking your real hands in live time and no need for gloves, they partnered with oculus and that has gone noware, but i can still control my computer with my hands and not touch the screen

6. sgodsell

Posts: 7363; Member since: Mar 16, 2013

Apple can say what ever they want, but when others make the actual displays, and right now. No one is using an 8k display on any smartphone or tablet, or VR headset. Nevermind dual 8k displays. I will bet money that you won't see anyone with a dual 8k display on a VR or AR headset next year or by 2021. Now before we go on there is one OEM with a 8k VR headset called PiMAX. Yet it is really two 4k displays. So it's half the resolution of one 8k display, or a 1/4 of the resolution that Apple is claiming that they will have by 2021. Think about the data for two 8k displays. That works out to 7680x4320x2x4 = 256.4 MB per frame. If you have 60 frames in one second, then that works out to 16 GB for one second. Mobile processing has to increase 8 fold, or more. That is not including the amount of data from the cameras needed for AR. In other words if desktop AR and VR isn't there yet, mobile is still a long way off.

7. gadgetpower

Posts: 155; Member since: Aug 23, 2019

We’ll see about it soon.

9. sgodsell

Posts: 7363; Member since: Mar 16, 2013

You can say we'll see about it soon. But an AR headset with dual 8k displays, that is not happening for a long time. How about we see Apple use a single 4k display on any headset, first. Then maybe a single 8k headset later, which is 4 time the resolution of a 4k headset. A dual 8k headset is 8 times the resolution of a 4k headset. Apple's iPhones today don't even do QHD+ resolutions. The iPhone XS Max resolution is 2688x1242x4=13.3 million bytes of data per frame. The Note 10+ resolution is 3040x1440x4=17.5 million bytes of data per frame. If you want 60 fps that's 1 GB of data, at 90 fps then that's 1.6 GB of data every second. This doesn't include all the processing needed for the camera images, overlays, or graphics needed. Nevermind input controls as well. A 4k headset is even more data. As far as a final product with dual 8k displays, and cameras, and be mobile. I will bet money that is not going to happen by 2021.

8. cmdacos

Posts: 4198; Member since: Nov 01, 2016

Yet another bad design decision by apple. Anyone that lives in warmer climates doesnt want to wear gloves as they walk around. Just stupid UX.

Latest Stories

This copy is for your personal, non-commercial use only. You can order presentation-ready copies for distribution to your colleagues, clients or customers at https://www.parsintl.com/phonearena or use the Reprints & Permissions tool that appears at the bottom of each web page. Visit https://www.parsintl.com/ for samples and additional information.