Contextual object recognition on steroids: Google Lens makes phones' cameras "smart"

Contextual object recognition on steroids: Google Lens makes phones' cameras
Google's keynote at Google I/O 2017 is going full speed ahead as we speak, and one of the first intriguing new things unveiled on stage was Google Lens. 

No, Google is not reanimating the failed Glass wearable, but supercharging the object recognition capabilities of its Assistant and Photos apps. Google lens is a set of vision-based computing capabilities that will also let you take action based on the subject. You will be able to point your phone's camera at an object and it will automatically scour the web for any information that pertains to the object you want to learn more about. 

For example, point your phone at a flower and Google Lens will do its best to identify the exact plant species. It will also allow users to point their camera at a venue and any relevant data from Google Maps will immediately pop up on your screen. Pointing your phone at text in a foreign language will allow Google Assistant to immediately translate that into your mother language. You will also be able to automatically connect to a Wi-Fi network by simply pointing your camera at the network's SSID and password. Neat!

Basically, it will use your camera as a search box, which will deliver any relevant data to you courtesy of Big G's vast object-recognizing neural networks. 

Google lens will first arrive on the Google Assistant and Google Photos, but will get more intertwined with Google's app ecosystem as time goes by.



FEATURED VIDEO

13 Comments

1. AgentZero

Posts: 314; Member since: Aug 16, 2014

R.I.P Bixby , dead before even being born

4. Bankz

Posts: 2548; Member since: Apr 08, 2016

Samsung are the ultimate embodiment of this quote "A jack of all trade and master of none". That person probably had samsung in mind when he made it.

5. peace247 unregistered

We get it man...you hate samsung...now just stfu. And FYI...samsung is master in phone design, screen technology, camera(maybe not master buy neck to neck with the best).

7. Bankz

Posts: 2548; Member since: Apr 08, 2016

Err.. Lmao Nope, they are not master in phone design (and never have been). It only looks like they are masters in screen because they can bully most other oems with their financial muscle. They're lucky apple havent really being interested in screen manufacturing (until now that is), otherwise apple would have bullied them on that turf too, as usual. When apple designes their samsung-supplied oled screen, we shall see who display mate awards the best screen in the industry.

8. omnitech

Posts: 1131; Member since: Sep 28, 2016

Lol . You keep on believing that yard. Samsung is the master of a lot of things hardware related. It's not even debatable.

9. cmdacos

Posts: 4220; Member since: Nov 01, 2016

There's is no better in hardware design for the last three years.

2. Bankz

Posts: 2548; Member since: Apr 08, 2016

So, what bixby hopes to be?

3. peace247 unregistered

RIP bixby.

6. zelas

Posts: 41; Member since: Sep 25, 2013

umm.. bye Bixby.

10. Crispin_Gatieza

Posts: 3139; Member since: Jan 23, 2014

This is Nokia City Lens 5 years late.

11. trojan_horse

Posts: 5868; Member since: May 06, 2016

This should be good.

12. Sammy_DEVIL737

Posts: 1529; Member since: Nov 28, 2016

Welcome to Bixby vision.

13. cleatglitch

Posts: 165; Member since: May 25, 2013

if i take a selfie...will it tell me all the people who hav a warrant in the photo

Latest Stories

This copy is for your personal, non-commercial use only. You can order presentation-ready copies for distribution to your colleagues, clients or customers at https://www.parsintl.com/phonearena or use the Reprints & Permissions tool that appears at the bottom of each web page. Visit https://www.parsintl.com/ for samples and additional information.