x PhoneArena is hiring! Reviewer in the USA
  • Options
    Close





Here are the new benchmark tests we will be using in our reviews

0. phoneArena 17 Sep 2013, 10:10 posted on

Synthetic benchmarks should be approached with care, because putting too much trust in those numbers may result in unnecessarily high (or low) expectations of a device's performance. Indeed, it is real-world usage that counts, but still, benchmarking shouldn't be ignored altogether. After all, there are some tests that can actually give us a pretty good picture about certain aspects of a phone or a tablet...

This is a discussion for a news. To read the whole news, click here

posted on 17 Sep 2013, 10:14 12

1. Ninetysix (Posts: 2549; Member since: 08 Oct 2012)


Looks good.

posted on 17 Sep 2013, 10:53 1

17. buccob (Posts: 2613; Member since: 19 Jun 2012)


Looks very good... but will this test be updated to show information of older phones or reviews? or will this only work from now on?

posted on 17 Sep 2013, 11:13 17

18. Ray.S (Posts: 369; Member since: 19 Jul 2011)


We'll make sure to test a good number of recent smartphones so that there's a useful database with results.

posted on 17 Sep 2013, 11:16 2

19. adrialk (Posts: 20; Member since: 04 Sep 2013)


Please make sure to include the Droid MAXX!

posted on 17 Sep 2013, 12:02

23. buccob (Posts: 2613; Member since: 19 Jun 2012)


Thanks, good to hear

posted on 17 Sep 2013, 12:37

28. rd_nest (Posts: 1646; Member since: 06 Jun 2010)


Why still using Quadrant and AnTuTu?

Nobody so far defined how exactly Quadrant and AnTuTu gives the score.

IMO, much better using something like 3DMark (cross-platform). Browsermark, Geekbench etc.,

posted on 17 Sep 2013, 12:45 1

29. neutralguy (Posts: 1152; Member since: 30 Apr 2012)


This is actually a very good upgrade to the site. Especially with regards to the battery, camera, and display tests.

posted on 17 Sep 2013, 10:14 4

2. rawbow (Posts: 428; Member since: 30 Mar 2012)


Nice work, and you have made it interactive. Pretty Neat!

posted on 17 Sep 2013, 10:16 7

3. PhoneArenaUser (Posts: 5498; Member since: 05 Aug 2011)


Nice, PhoneArena! Now let's hope that results will be fair and not biased. :)

posted on 18 Sep 2013, 04:43

44. rihel_95 (Posts: 301; Member since: 21 Mar 2012)


hey PA, check fps of Nexus 4 in GFXBench Egypt HD 2.5 onscreen using new benchmark chart...it says 4917! WTF...others are around 50...

posted on 17 Sep 2013, 10:17 16

4. PapaSmurf (Posts: 10457; Member since: 14 May 2012)


This should put an end to many fanboys saying the review was biased.

posted on 17 Sep 2013, 10:21 5

8. rawbow (Posts: 428; Member since: 30 Mar 2012)


The reviews are always biased in the eye of the beholder. What people fail to understand is that reviews too are done by humans and thus are still perspectives.

posted on 17 Sep 2013, 10:25 3

9. Immolate (Posts: 310; Member since: 17 Jun 2011)


But some aspects of a phone's appeal are subjective and can't be captured by a benchmark. Aesthetic is one. The "feel" of a handset is another. The quality of the outbound and inbound voice signal isn't really entirely subjective, but there are so many variables involved that it might as well be. The verdict on such subjective criteria tends to evolve from the aggregate. But still, your point is taken. Having hard data on the real capabilities removes much of the subjectivity.

posted on 17 Sep 2013, 10:31

11. PhoneArenaUser (Posts: 5498; Member since: 05 Aug 2011)


"But some aspects of a phone's appeal are subjective and can't be captured by a benchmark."

True, but since these benchmarks are not about these aspects...

posted on 17 Sep 2013, 10:33 2

12. LordDavon (Posts: 136; Member since: 19 Sep 2011)


I wish, but fanboys are fanboys. This is only one aspect of a review, and while the benchmarks are going to be cleaner and interactive, there is still so much more making up a review. But, we can hope it helps. ;-)

posted on 17 Sep 2013, 10:50 6

15. buccob (Posts: 2613; Member since: 19 Jun 2012)


You are correct, but Reviewers should understand that you can ONLY rate quantitative characteristics such as display measurements, sound loudness... etc... like what they just update here

And things like "how pretty" or "we like this skin better" is complete subjective opinion, which is finally up to each user or buyer, and should NOT be rated... or at least it should follow certain parameters

So yeah this should help lessen both the bias in reviews and the hating in the comments

posted on 17 Sep 2013, 10:18 1

5. bubbadoes (Posts: 1225; Member since: 03 May 2012)


we'll

posted on 17 Sep 2013, 10:20

6. tech2 (Posts: 3487; Member since: 26 Oct 2012)


Finally phonearena..............Finally !

posted on 17 Sep 2013, 10:20 1

7. Immolate (Posts: 310; Member since: 17 Jun 2011)


Very nice. But just as a phones real test is how it works in real life, the real test of these imaginative benchmarks will be how well they parallel our actual experiences. My take on benchmarks and companies designing their device to "cheat" them is that if your benchmarks measure actual benefits to the end-user, then cheating them simply makes your device better for the end user. Cheat all you want.

posted on 17 Sep 2013, 10:28

10. LordDavon (Posts: 136; Member since: 19 Sep 2011)


I like that you can add a device, but is there a way to remove one if accidentally added?

posted on 17 Sep 2013, 10:52

16. theruleslawyer (Posts: 108; Member since: 23 Apr 2012)


Just refresh the page. It'll reset it.

posted on 17 Sep 2013, 13:46

34. LordDavon (Posts: 136; Member since: 19 Sep 2011)


Yes, but when there are several benchmarks on a single page, it will reset all of them. Would rather not start from the beginning due to one mistake.

posted on 17 Sep 2013, 10:45

13. Zakriya (Posts: 11; Member since: 05 Aug 2013)


Sony Xperia Z has everything on par in displays with others...Why the contrast is too low?
i think you should re do the display measurements of Z as it has some improvments in my opinion

posted on 17 Sep 2013, 15:22

35. sulre (Posts: 18; Member since: 08 Sep 2013)


well, because it's TFT TN. Check out the result of cantrast ratio on Xperia Z on GSMArena, it tells u the same.

posted on 17 Sep 2013, 10:47 2

14. buccob (Posts: 2613; Member since: 19 Jun 2012)


Great work... Hopefully this lessen the bias reviewer issue and also the fan rage in the comments

posted on 17 Sep 2013, 11:26

20. McLTE (Posts: 922; Member since: 18 Oct 2011)


Wait.. PA can hardly write an article without obviously fanboyism, massive punctuation and grammatical errors... now they have developed their own benchmarks?

I don't know whether I should be encouraged since maybe their poor writing is due to their talents residing with things more technical.. or should I be scared?

I'll go for scared.

posted on 17 Sep 2013, 11:30

21. cezarepc (Posts: 718; Member since: 23 Nov 2012)


There's something like this on another popular review site, but I like this one better because you can add phones (so you can compare easier). Pretty neat.

One suggestion I can make is to use a theoretical limit for a pixel that is off (Display measurements and quality). You can use 0.000001 nits for all AMOLED screens so that we can have a figure to compare with. It's not the real result yes, but will give us an idea of how AMOLED screen from one phone can compare to an AMOLED screen of another.

posted on 17 Sep 2013, 11:48

22. aries.phills (Posts: 140; Member since: 17 May 2011)


This is pretty cool and intuitive. Great idea by a great tech website. Now I feel like I should be part of phone arena team.
Kudos guys.

posted on 17 Sep 2013, 22:17

39. pwnarena (Posts: 1129; Member since: 15 Feb 2013)


the only problem is that they don't seem credible. look at the battery numbers. sony phones get good scores in comparison to others that are known for having better battery longevity. i don't think that's accurate.

posted on 17 Sep 2013, 12:06 1

24. Tuxedo (Posts: 353; Member since: 19 Mar 2013)


Two comments:

1. When measuring output voltage of the headphone jack, you need to use a standard load (headset), otherwise, results will be meaningless.

2. I'd like to see a "sleep mode" battery life test... say how much battery is used in a given period of time (say 24hrs) in which the device is in sleep mode, radios on, sync on etc.

* Some comments have been hidden, because they don't meet the discussions rules.

Want to comment? Please login or register.

Latest stories