Here are the new benchmark tests we will be using in our reviews

Here are the new benchmark test will be using in our reviews
Synthetic benchmarks should be approached with care, because putting too much trust in those numbers may result in unnecessarily high (or low) expectations of a device's performance. Indeed, it is real-world usage that counts, but still, benchmarking shouldn't be ignored altogether. After all, there are some tests that can actually give us a pretty good picture about certain aspects of a phone or a tablet.

We think you know where this is going. Ladies and gents, allow us to introduce our new benchmarks! Let us elaborate: we've come up with a number of somewhat more scientific tests that we'll use to study the devices' displays, system performance, camera speed, audio output and... that's right - battery life! The results will be easily visible in the respective device's review. Here's a glimpse of how the new benchmarks are going to look!

  • When it comes to displays, we'll be providing you with quite a lot of information. For example, you'll be able to see a display's maximum and minimum brightness, contrast, color temperature, Delta E, color gamut and more. We've tried to make it all easy to use and understand.

  • Up next, we'll continue to check performance of Android phones by running some of the most popular performance benchmarks out there, but we'll be displaying the results in a new, more appealing type of visualization.
Quadrant Higher is better
Sony Xperia Z Ultra 18158
HTC One 12481
Samsung Galaxy S4 12078
AnTuTu Higher is better
Sony Xperia Z Ultra 29732
HTC One 23308
Samsung Galaxy S4 24701
GFXBench Egypt HD 2.5 onscreen (fps) Higher is better
Sony Xperia Z Ultra 52
HTC One 31
Samsung Galaxy S4 39
Vellamo Metal Higher is better
Sony Xperia Z Ultra 1153
HTC One 781
Samsung Galaxy S4 704
Vellamo HTML 5 Higher is better
Sony Xperia Z Ultra 2937
HTC One 2395
Samsung Galaxy S4 1702

  • We'll be testing camera speeds in a couple of ways. The first one is our custom "Taking a pic" test, which will measure the time needed for a camera to launch, focus, take a picture, and get ready to take the next one. This test will also have a separate result for HDR photo-taking. We'll also post the scores we've got using the cross-platform Camspeed benchmarking app.
Taking a pic Lower is better Taking an HDR pic (sec) Lower is better CamSpeed score Higher is better CamSpeed score with flash Higher is better
Apple iPhone 5 2.7
Sony Xperia Z 3
Google Nexus 4 2.8

  • Moving on to the audio output, there are two things we're going to measure in this regard. The first is the output power of the 3.5 mm headphone jack (in volts), and the second one is the loudspeaker's loudness (in decibels).
Headphones output power (Volts) Higher is better
Apple iPhone 5 0.54
Sony Xperia Z 0.37
Google Nexus 4 0.28
Loudspeaker loudness (dB) Higher is better
Apple iPhone 5 71
Sony Xperia Z 67
Google Nexus 4 80

  • Finally, we've created a custom battery life benchmark to test phones with. It's a special script, designed to replicate real-life usage. The results for each handset or tablet will be provided in hours and minutes.

We measure battery life by running a custom web-script, designed to replicate the power consumption of typical real-life usage. All devices that go through the test have their displays set at 200-nit brightness.

hours Higher is better
Sony Xperia Z
4h 48 min (Poor)
Apple iPhone 5
4h 22 min (Poor)
Google Nexus 4
4h 47 min (Poor)

Of course, keep in mind that all of these benchmarks are quite new, so we might continue polishing and improving them during the days ahead.

New reasons to get excited every week

Get the most important news, reviews and deals in mobile tech delivered straight to your inbox

FCC OKs Cingular\'s purchase of AT&T Wireless