Can Pixel 4's radical Motion Sense navigation spell 'the end of the touchscreen'?

Can Pixel 4's radical Motion Sense navigation spell 'the end of the touchscreen'?
There is a reason why Google is going with a giant top bezel on the Pixel 4, in times where the Note 10 will be the most compact large-screen phone in our database precisely on account of the shaved-off strip there. No, that reason is not a 3D face-scanning kit, although there will be one, and Google is collecting faces to perfect it at $5 a pop.

Looking at the leaked renders and screen protectors, there was a mysterious and quite large cutout on the right of the Face ID-style module. The best guess was that Google will use it to revolutionize its Pixel phones' interface navigation by introducing the gesture recognition platform it has only had in prototype form so far, and Google just confirmed it will indeed employ it with the official name Motion Sense. The chip that makes it possible is dubbed "Soli," and employs "a new sensing technology that uses miniature radar to detect touchless gesture interactions." 

Google's Project Soli sounds suspiciously like what LG did with the Multi ID and hand-tracking algorithms enabled by the 3D-sensing front camera kit on the G8 ThinQ, yet relies on radar waves to detect the motion of the human hand. You know, like in this GIF below:


Google's successful miniaturization of the technology fits in a Soli chip that is small as a pinky nail, yet can detect the minutest of motions. It works on the same principle as the big flight radars that detect airplane movements in the sky. Unfortunately, this was precisely why the FCC didn't let the Soli chip fly until December 31 2018, when it granted Google a waiver from some of its requirements for radars in the commercial 57-64 GHz frequency band with the following:


How does Motion Sense work?


Google claims that the radar and the accompanying software can "track sub-millimeter motion at high speeds with great accuracy." The Soli chip does it by pushing out electromagnetic waves in a broad sweep that get reflected back to the tiny antenna inside. 

A combination of sensors and software algorithms then accounts for the energy these reflected beams carry, the time they needed to come back, and how they changed on the way, being able to determine "the object’s characteristics and dynamics, including size, shape, orientation, material, distance, and velocity." Despite that the small chip can't really bring the spatial recognition of larger installations, Google has perfected its motion sensing and predicting algorithms to allow for slight variations in gestures that will be transformed into one and the same interface action.


The technology is thus superior to the 3D-sensing cameras at the front or back of some phones which depend on line of sight and lighting conditions. Here's the initial brief on Google's Soli tech that will debut on the Pixel 4 in a retail version for the first time.



Motion Sense brings a universal set of gestures


Hand gestures come more natural than pushing against a piece of glass, yet so far the technology for their recognition on a phone has been imperfect as it relied on camera sensors. Google is aiming to revolutionize the interaction with our mobile devices by employing the radar-based Motion Sense technology which would include, but not be limited to, the following natural gestures that can be employed in any orientation of the phone, day or night.


So, can the world be your interface?


Google is known for its "moonshots," or crazy-sounding projects that it thinks will ultimately prove their mettle as time goes by. So far, the Google X moonshot lab has bagged incredible technology leaps like the self-driving car efforts, smart contact lenses, and other eye-poppers. The Motion Sense gear on the Pixel 4 could be one small step for Google's hardware department, and one giant leap for the future of the smartphone interaction. 

In fact, the guy behind Project Soli, Google's Ivan Poupyrev that you saw in the video above, recently gave a TED talk explaining how this radar-based gesture navigation can be deployed everywhere in a "the world is your interface" kind of moment.


While we can't really comment on the practicality of Google and Levi's Project Jackard idea that employs the motion sensing gizmo in a jeans jacket, getting it into the Pixel 4 is a whole different ball game. 


Google's Pixel 4 and Motion Sense


Just when we were preparing this primer on Project Soli, Google came out confirming that this will indeed be the tech occupying the mysterious openings at the right of the thick top bezel on the Pixel 4. In its blog post, the company went through the same points and advantages we list above in more detail. Apparently, it all ties up with Google's head of hardware Rick Osterloh "ambient computing" strategy which he explains as:


What's a bit worrying, however, is that Google lists the Motion Sense abilities on the Pixel 4 as "skip songs, snooze alarms, and silence phone calls, just by waving your hand." Not for nothing, but those are the things that LG does on the G8 ThinQ just with the front camera kit, no fancy miniaturized radars, no bezelicious sprawling at the top. 

What about scrolling with an air flick of the finger through long articles, or going back in the interface with a simple thumb twitch, though? Google does wax poetic that this is just the start and "Motion Sense will evolve," but we've heard many a marketing writeups for options and features that ultimately prove to be slow on the uptake. 


That Motion Sense "will be available in select Pixel countries" bit is also raising a few eyebrows, as to why would a Pixel 4 model in one place come with the radar-based gesture navigation, while in others it won't. Is it because different countries have different rules on commercial radars in the 57-64 GHz frequency band and some are reluctant to accept the FCC's waiver? 

We probed Google with the question and will get back to you here when we get a nod. What do you think, could Pixel 4's Motion Sense be the "end of the touchscreen" and the beginning of the "world is your interface" era indeed, and is it too early to tell, or too complex of an interaction paradigm to take off?

Will Google revolutionize the phone interface with Motion Sense on Pixel 4?

Yes
31.52%
Too early to tell
48.9%
No
19.58%

Related phones

Pixel 4
  • Display 5.7" 1080 x 2280 pixels
  • Camera 12 MP / 10 MP front
  • Processor Qualcomm Snapdragon 855, Octa-core, 2840 MHz
  • Storage 128 GB
  • Battery 2800 mAh

FEATURED VIDEO

32 Comments

1. ssallen

Posts: 193; Member since: Oct 06, 2017

I am a bit bummed that they are adopting face unlock but the Soli stuff looks cool. I guess with the ambient computing initiative face unlock is within the metaphor, but yuck.

15. sgodsell

Posts: 7368; Member since: Mar 16, 2013

I was hoping that Google would use the ultrasonic fingerprint scanner under the screen as well. If they are using face only, and dropping the fingerprint scanner altogether, then Pixel 4 won't be for me.

2. Cat97

Posts: 1892; Member since: Mar 02, 2017

Google is also known for its many closed projects and apps, too many to count.

5. TBomb

Posts: 1484; Member since: Dec 28, 2012

I personally think we need to cut google some slack in that department. It also has some very long projects and initiatives. There was a period where they were trying anything and everything - those projects came to a close because they were part of the "try it" phase. It's true, a lot of non-moonshot projects ended as well. But you have to look at what google's intentions were for that project. what was their goal and Is there a better way to reach that goal?

30. vincelongman

Posts: 5693; Member since: Feb 10, 2013

Same with Apple, Samsung, Microsoft and every other major tech company lol

3. Plutonium239

Posts: 1215; Member since: Mar 17, 2015

In order for this sort of thing to revolutionize how we all interact with our devices, it would need widespread adoption by many manufacturers, not just being present on the up coming pixel. The technical achievement of shrinking radar down so far is nonetheless impressive.

6. slim3bdo

Posts: 173; Member since: Jun 05, 2017

And how would you revolutionize the industry without implementation . 1st iphone came was garbage as a phone compared to other phones but it brought multi touch interface and everybody followed . So if google implementation is good enough , the whole industry will follow . If it work as said then its a breakthrough in a stagnant industry and it WILL revolutionize every gadget we have today.

4. surethom

Posts: 1691; Member since: Mar 04, 2009

It look cool & impressive technology, but for most it will just be a gimmick, most will try it out at first then never use it again, just use touch.

7. adecvat

Posts: 640; Member since: Nov 15, 2013

Another gimmick

8. cmdacos

Posts: 4208; Member since: Nov 01, 2016

Amazing technology but is motion gestures easier to use then my finger on a handheld device? Seems awkward to use when you are holding the device.

9. Poptart2828

Posts: 395; Member since: Jan 23, 2018

Everything is a gimmick around here in PA.

10. dumpster666

Posts: 74; Member since: Mar 07, 2019

it's not meant to replace touch... it's there to compliment it.

11. kevv2288

Posts: 295; Member since: Jul 30, 2015

You mean you have to use your hands? That's like a baby's toy.

14. nuumuun

Posts: 4; Member since: Mar 12, 2015

I see a back to the future reference ... I like :D

12. mackan84

Posts: 459; Member since: Feb 13, 2014

Wasn’t it a display a couple of years ago that registered touch when hovering your finger precisely above it?

13. torr310

Posts: 1659; Member since: Oct 27, 2011

Just by reading at the title....nope! We still cannot get rid of the touch screen with typing. LOL

16. Leo_MC

Posts: 7432; Member since: Dec 02, 2011

I was talking a few months ago about the fact that the time of (touch)screens should end and we should walk into a new era; this could be it.

17. japkoslav

Posts: 1507; Member since: Feb 19, 2017

BS, thank you for your contribution PA.

18. Takeharu

Posts: 285; Member since: Oct 28, 2013

It's just like motion controls for gaming. For years Sony, Nintendo and Microsoft tried to make gaming more interactive and immersive with motion controls but in the end nothing is more intuitive than just moving my thumb a few centimeters; this goes for both a touch screen and a controller

19. lyndon420

Posts: 6790; Member since: Jul 11, 2012

I appreciate the tech involved, but saying 'the end of the touchscreen' is a bit misleading. We still need to touch the screen to type so...

22. Leo_MC

Posts: 7432; Member since: Dec 02, 2011

You can just... I don't know... how about talk to the device.

24. lyndon420

Posts: 6790; Member since: Jul 11, 2012

Uhmmm...riiight lol. Because we all want to hear our private conversations out loud for everyone to hear. Imagine being on a bus with a quarter of the people on it texting, or doing a lengthy email etc...

25. cmdacos

Posts: 4208; Member since: Nov 01, 2016

I agree but there are morons all around us having FaceTime calls in public at full volume. The same morons that preach privacy as a core value of why they chose their device.

28. Leo_MC

Posts: 7432; Member since: Dec 02, 2011

Oh, yes, I've seen some of them that put their phones next to their ears and talked by themselves, like crazy people. /s That's called "voice/video call" and it's exactly why the mobile PHONE exists. Human beings like to talk to each other, you know, they don't text when they meet.

27. Leo_MC

Posts: 7432; Member since: Dec 02, 2011

You do know that text - as a main method of communicating - is not even 10 years old? Remember when people could not conceive that they can input text fast and with ease, using anything but a qwerty physical keyboard? Well, we did it, almost no phone today uses a physical keyboard, so I'm sure we'll figure a new way to do it ;).

20. TBomb

Posts: 1484; Member since: Dec 28, 2012

I see some games an apps even making use of the tech. Learn sign language by it tracking your hand and correcting you when you do it wrong Harry Potter spell casting games or other gesture based games Snapchat and Instagram filters will get better tracking

23. Demo-jay

Posts: 69; Member since: Feb 13, 2018

This is probably gonna fail..there is definitely gonna be a problem with this gimmick..google doesn’t really polish their software...customers are beta testers

26. berns

Posts: 36; Member since: Jun 07, 2014

It will be a very cool addition to phone's sensors, but to end the touchscreen is far from ease of usability perspective, as how you would hold a phone if you need to actuate more than 1 controls as the same time, as on playing games, nevertheless, it is a welcome add-on, and one very good usage for this that I see is for scanning object to create 3D model.

29. mootu

Posts: 1519; Member since: Mar 16, 2017

I wonder if anyone has thought about the effects on human health? Radar RF waves in low doses are still unknown if they cause ill effects in humans, the tech has been around for a very long time but they have never been able to declare it as safe.

32. Mike88

Posts: 402; Member since: Mar 05, 2019

They actually want to make people sick

Latest Stories

This copy is for your personal, non-commercial use only. You can order presentation-ready copies for distribution to your colleagues, clients or customers at https://www.parsintl.com/phonearena or use the Reprints & Permissions tool that appears at the bottom of each web page. Visit https://www.parsintl.com/ for samples and additional information.