How does the Amazon Fire Phone do its 'Dynamic Perspective' 3D magic?

You need to have at least two cameras looking at your face at all times - the Amazon Fire Phone has four, so two of them are never covered by your fingers.

You need to have at least two cameras looking at your face at all times - the Amazon Fire Phone has four, so two of them are never covered by your fingers.


The most notable feature of the new Amazon Fire Phone is something called Dynamic Perspective, a no-glasses 3D-like functionality embedded throughout the phone - from the wallpapers, to the refashioned Carousel interface, to apps and games. But how was Amazon able to pull such a trick?

Jeff Bezos took to the stage yesterday to unveil the new phone, and he also spoke about what challenges the company faced in bringing this to market. In fact, Bezos mentioned that the Fire Phone project started nearly 4 years ago, and the first prototypes were using glasses to recognize someone’s face. Not the best way to do it, is it?

In order to get rid of such unwanted head gear, Amazon had to double the cameras on initial prototypes - two cameras are the minimum for stereo vision with depth, but if you hold the phone in different orientation you can easily cover one of those two cameras with your hand. That’s why Amazon uses four cameras, so even when you hold this phone in landscape orientation, you still have at least two cameras looking at you.

The next challenge was the field of view of traditional cameras - at 72-degree field of view that most sport, a person’s head would go out of the frame way too often, causing the whole planned 3D effect to fail. That’s why Amazon had to equip the Fire Phone with custom-built, 120-degree, wider field of view cameras that would allow to have the user’s face in the view for the majority of use cases.

Going even deeper in the technological details, Amazon also unveiled that it uses global shutter cameras on the front rather than the more traditional rolling shutter ones. Global shutter cameras are faster, much faster, something that allows them to also use less power, as they are fired dozens of times every second. There is, in fact, a 10x difference in efficiency between a rolling shutter and a global shutter camera.

The next step towards perfecting this technology was using the phone in low light. After all, we often use our phones at night, or in a car, or generally, in poorly-lit conditions. To overcome this difficulty, Amazon uses infra-red light - a kind of light that we don’t see, but that the cameras can use at night to see where your face is in relation to them, and that’s exactly what makes the 3D-like effect possible.

Finally, Amazon has opened this new Dynamic Perspective SDK to developers on the day of the event, so if you’re a coder, you can start supporting the new 3D-like functionality in your apps right away - Amazon has made it all really simple.

Related phones

Fire Phone
  • Display 4.7" 720 x 1280 pixels
  • Camera 13 MP / 2.1 MP front
  • Processor Qualcomm Snapdragon 800, Quad-core, 2200 MHz
  • Storage 64 GB
  • Battery 2400 mAh

FEATURED VIDEO

16 Comments

1. Jason2k13

Posts: 1440; Member since: Mar 28, 2013

sounds great, but at the end of the day, most people just want a fast camera with good quality pictures.

3. CX3NT3_713

Posts: 2343; Member since: Apr 18, 2011

Those camera's aren't meant to take great photos, its for the 3D dept effect....yup

4. sam_tek

Posts: 105; Member since: Feb 18, 2011

lol, i think the OP was joking!

2. ArtSim98

Posts: 3535; Member since: Dec 21, 2012

But what exactly does this do? Does it "turn" the icons on the screen towards your face, or what?

5. SuperAndroidEvo

Posts: 4888; Member since: Apr 15, 2011

You need to hold one in your hand to really understand what it really is. There is no actual explanation that will make you understand the true effect like actually using the device. I am going to an AT&T store just too look at the device & see for myself once it's available to the masses...

6. TylerGrunter

Posts: 1544; Member since: Feb 16, 2012

The technology is known as "Head tracking" and the first public example known was with the Wii, the fun part starts at minute 2:30 :http://www.youtube.com/watch?v=Jd3-eiid-Uw The issue with the currren "3D" technologies is that they are in fact 2.5D, they show a 2D image+depth of field. This means that if you move your head you still see the same exact image, unliken in the real world, that if you move your head you see a slighly different one (objects are closer, or you see mor of one side). This tech solves that issue, when you move your head you seee what you should be seeing, but in this case still in 2D... If you combine both techniques, then you should have real 3D, but the only ones that have that right now are the Oculus Rift and Morpheus projects. Which is funny as you could get the same effect in your TV with the current technology, just by combining Kinect with a 3D TV. But no one have implemented it till the date. Sad but true...

7. HansGoneInsane unregistered

Yes and no. Yes: It is using 3D icons No: It does not only turn the icons towards your face but also turns the icons with the direction you turn your device.

11. ManusImperceptus

Posts: 724; Member since: Jun 10, 2014

He's talking about a regular 3D tv...

9. TylerGrunter

Posts: 1544; Member since: Feb 16, 2012

Another example working in a iPad:http://www.youtube.com/watch?v=bBQQEcfkHoE

12. HansGoneInsane unregistered

Apple has also the parallex effect in iOS7. It is a first step into that direction.

14. TylerGrunter

Posts: 1544; Member since: Feb 16, 2012

Rigth, but it´s a bit different. The parallex effect uses the accelerometers and position sensors of the phone, not head tracking. It only works when you move the phone, not your head and it doesn´t follow your sightline. So as you said is a first step, but still far from what Amazon has done.

16. radex

Posts: 7; Member since: May 30, 2014

i think you should watch mission impossible ghost protocol the scene inside the kremlin

8. AfterShock

Posts: 4146; Member since: Nov 02, 2012

This would be a phone I wouldn't charge in my bedroom at night.

13. CX3NT3_713

Posts: 2343; Member since: Apr 18, 2011

Why?..............................

10. isprobi

Posts: 797; Member since: May 30, 2011

I am more interested in the tilt gestures to control the phone. I hate oily touch screens. So the more things I can do without touching the screen the better. And I hope the integration with Amazon Prime music and video is really good.

15. gigaraga

Posts: 1454; Member since: Mar 29, 2013

Looks pretty good how it is open for other developers. I just don't get why every other smartphone camera uses rolling shutter when they can use global shutter?

Latest Stories

This copy is for your personal, non-commercial use only. You can order presentation-ready copies for distribution to your colleagues, clients or customers at https://www.parsintl.com/phonearena or use the Reprints & Permissions tool that appears at the bottom of each web page. Visit https://www.parsintl.com/ for samples and additional information.