x PhoneArena is looking for new authors! To view all available positions, click here.
  • Home
  • News
  • Qualcomm backing development of a new mobile benchmark standard

Qualcomm backing development of a new mobile benchmark standard

Posted: , by Maxwell R.

Tags:

Qualcomm backing development of a new mobile benchmark standard
In light of allegations that some manufacturers are fabricating benchmark tests to make their gear look and smell like a rose when in reality it might actually smell like something else, Qualcomm is backing an effort by Berkeley Design Technology Inc., BDTI, to create new and independent user experience rating scheme for mobile devices.

There have been some assertions that Antutu favors Intel based architecture, so this backing by Qualcomm is arguably not without an agenda.

According to BDTI, "Many existing mobile benchmarks do not measure attributes relevant to consumers and can be easily manipulated. There is a striking lack of mobile benchmarks that measure actual user experience. Our user-experience-focused tests will include real-world measurements of application performance, battery life, and data transfer speed and delay."

The new standard will be designed solely with mobile technology in mind and the benchmarks will note common scenarios rather than complex equations. Qualcomm states this solution is “timely.”

BDTI will have an initial public device results report available later this year and there will be general availability in early 2014.

source: Qualcomm

13 Comments
  • Options
    Close




posted on 21 Aug 2013, 15:53 14

1. noler (Posts: 164; Member since: 19 Aug 2013)


"some manufacturers are fabricating benchmark tests to make their gear look and smell like a rose when in reality it might actually smell like something else"
Shame on you Samsung!

posted on 21 Aug 2013, 16:07 10

2. Shatter (Posts: 1989; Member since: 29 May 2013)


Samsung auto overclocks the cpu when needed so it will still have an edge. It is not a benchmark fake it works in every app that needs extra power.

posted on 21 Aug 2013, 16:26 8

3. Igneel (Posts: 19; Member since: 23 Jul 2013)


If I'm not mistaken, it overclocks on 'certain' benchmarks only.. So yeah. Not every app that needs extra power

posted on 21 Aug 2013, 17:00 6

5. Dr.Phil (Posts: 897; Member since: 14 Feb 2011)


You are somewhat mistaken as it also overclocks on most of their standard applications such as the web browser, video player, and other full-screen Samsung applications.

posted on 21 Aug 2013, 17:41 3

6. Ninetysix (Posts: 1476; Member since: 08 Oct 2012)


No Dr.Phil. Only the whitelist apps will run at 532/533. if the app is not in the whitelist, it runs at 480.

http://www.anandtech.com/show/7187/looking-at-cpugpu-benchmark-optimizations-galaxy-s-4

posted on 21 Aug 2013, 18:24

7. jdoee100 (Posts: 305; Member since: 04 Jun 2013)


I did not read the whole anandtech article, but this is from the verge concerning the same article, "but the site(Anandtech) did note that other benchmark apps that are not explicitly mentioned in code were also behaving the same way." So this means, other programs do run at higher speeds, not just the whitelist.

posted on 21 Aug 2013, 18:39 3

8. special4u (Posts: 63; Member since: 22 May 2013)


samsung foreseen oneday their lies will broke, so they put in others "application" to argue in future. lol

web browser??
video player??
full screen samsung application??

why not games & others calculate intensive apps????

posted on 22 Aug 2013, 02:52

14. DannydaKid (Posts: 4; Member since: 15 May 2013)


Yeah, why not some graphic benchmark either, what Samsung did is letting the GPU run at the "designated clock" for a "Overall Benchmark", not a "GPU Benchmark" such as GLBench . They must be very stupid as well, and nice sacarsm :lol:

posted on 21 Aug 2013, 18:44

10. joey_sfb (Posts: 2748; Member since: 29 Mar 2012)


Its very common in the PC industries to do this, ATI and Nvidia has been doing this for years and accuse the other parties for it.

What i see is mobile performance is getting more and more attention and is good for me as i like to play a lot of mobile games.

posted on 21 Aug 2013, 16:39

4. james004 (Posts: 471; Member since: 15 May 2013)


then this comes down to the developers of benchmarks and their honesty.
people believe in those apps and developers should respect it. update the apps to standardize the platform and avoid false benchmark reports that OEMs might be trying to cheat into.

posted on 21 Aug 2013, 18:43

9. kozza3 (Posts: 574; Member since: 17 Oct 2012)


how hard is is to make a benchmark that can't be abused?

posted on 21 Aug 2013, 23:02

13. zennacko (Posts: 227; Member since: 16 Jun 2013)


Not hard at all when you're not a part of industry (so they can't tell you're somehow biased towards X or Y manufacturers). But then they'll tell you "clearly have a lack of expertise in the industry (because you're not a part of it) and market, thus your benchmark results could be fake and by all means unreliable"

Let's see how fair this Qualcomm-supported benchmark will be towards Intel, Samsung, MediaTek and other manufacturers...

posted on 21 Aug 2013, 21:52

12. marbovo (Posts: 621; Member since: 16 May 2013)


What is needed is an app that colect data on a period of time, like hours or even days not just on the app execution, I think that would be very hard to cheat

Want to comment? Please login or register.

Latest stories