Patent application reveals how you will use Apple's next big thing

Patent application reveals how you will use Apple's next big thing
Earlier this month, a report stated that Apple had "temporarily stopped" developing the AR-based Apple Glasses. This was the device that was expected to be Apple's "next big thing" and one analyst predicted that it would be bigger than the iPhone. According to CNET, Apple is still planning on releasing a mixed reality headset next year that would support both AR and VR, and feature 8K displays for each eye (7680×4320 to be precise). To put that in context, the HTC Vive Pro VR headset features a 1400 x 1600 resolution.

In April 2018, a massive leak revealed the above specs and also indicated that the headset will be powered by a 5nm processor. Currently, the 7nm process is used on chips like the Apple A11 and the Snapdragon 855 and TSMC is expected to churn out 5nm components next year. The smaller the process number, the higher the number of transistors inside the chip. So theoretically, a 5nm processor should be more powerful and conserve more energy than currently available components. The model number mentioned in today's report, T288, dates back to November 2017. Back then, the information that leaked revealed the name of a new operating system developed for the headset: rOS (for Reality Operating System).

The headset could be used for gaming, viewing digital media, browsing the web and more

Earlier this month, the U.S. Patent and Trademark Office (USPTO) published a related patent application filed by Apple. Titled Display System Having Sensors, the application discusses a head-mounted display (HMD) that uses mixed reality (AR/VR). The HMD includes sensors that gather information about the user and his or her environment. This information would include the user's expression, eye movement and hand gestures. The sensors might include one or more cameras to provide the user with a real-world view.

The mixed reality headset would merge the real-world environment captured by the sensors with the graphics created for virtual reality.  It also would show an avatar of the user's face based on "information collected by the one or more eye-tracking sensors, the one or more eyebrow sensors, and the one or more lower jaw sensors." The patent says that the HMD could sport a projector to project or display images to the user's left and right eyes and would work with applications that add virtual content to a real-world view. Examples of such applications mentioned in the patent include virtual training, gaming, viewing digital media, and browsing the web.

The patent application was originally filed by Apple back in September 2017.



1. sgodsell

Posts: 7533; Member since: Mar 16, 2013

There isn't any 8k displays small enough. They don't exist, period. Plus two 8k displays is just stupid. Most likely it will be a 4k display, with maybe two 4k displays after that. PhoneArena try to think a resolution of (7680x4320 x 4 color) = 132 mb per frame. If you times that by 2, then that is 264 mb per frame, and at 60 fps = a staggering 16 GB a second. That doesn't include all the graphics rendering, or processing involved. Maybe if that is done on a desktop processor and GPU. But on a mobile SoC. I don't see that happening anytime soon. Not for at least another 4-5 years, and maybe if they are down to 2nm or 3nm manufacturing.

2. TerryD

Posts: 560; Member since: May 09, 2017

60hz isnt usually sufficient for VR which is why most VR systems are 90 or 120hz. Not sure what the source is but you're right, even 2x 4k at 60fps is more than most graphics cards on high end PC's can handle at the moment. Maybe Apple has steathily developed a GPU twice as quick and about 10 times more efficient than those that AMD and nVidia are churning out.

4. sgodsell

Posts: 7533; Member since: Mar 16, 2013

75 hz is fine if you don't have a lot of objects and rendering going on in the scene. You can even get away with 60 hz. However I agree the faster the better. I have the Oculus Rift, and 90 hz is more than fine. It's nice to dream, but nobody has displays this high, period. Wouldn't you think Magic Leap, and Microsoft Hololens would have both used higher resolution displays if they had them. Even Samsung, Google, and Facebook would be using them by now. But they just don't exist.

3. TerryD

Posts: 560; Member since: May 09, 2017

Doesn't that Patent sound a bit like Microsoft Hololens?

6. Poptart2828

Posts: 459; Member since: Jan 23, 2018

Another device locked into their walled garden

Latest Stories

This copy is for your personal, non-commercial use only. You can order presentation-ready copies for distribution to your colleagues, clients or customers at or use the Reprints & Permissions tool that appears at the bottom of each web page. Visit for samples and additional information.