Samsung denies cheating on benchmark tests
0. phoneArena 03 Oct 2013, 13:06 posted on
The evidence seems pretty hard to argue, but Samsung wants to try anyway. Multiple sources have found that Samsung (as well as most other Android manufacturers) artificially boost CPU frequencies when the system detects a benchmarking test running. Samsung is denying that its devices are trying to cheat the tests, and is actually putting the blame on the tests themselves...
This is a discussion for a news. To read the whole news, click here
18. asingha94 (Posts: 295; Member since: 08 Apr 2012)
every thief says that!biggest copycat and troll in tech industry!
20. stuyjcp (Posts: 31; Member since: 29 Apr 2012)
Someone please tell me if this "maximization" applies to games or not. If it does, then why's it matter if it applies to benchmarks as well?
22. Ninetysix (Posts: 2339; Member since: 08 Oct 2012)
Because they are using a whitelist. If the app's name matches the name in the whitelist, they are maximized. Not in the list, it'll be running at normal speeds (nexus).
24. androiphone20 (Posts: 1654; Member since: 10 Jul 2013)
when gpu/cpu goes up battery life and
product reliability suffers
31. Jobayer (Posts: 167; Member since: 22 Feb 2013)
no it doesnt apply to games only benchmarks app thats y its cheating ! or else y dont it be ? dont u think sammy ppl r smart enough to take it to their advantage if that was the case not just sly by .
25. redcloudsk (Posts: 9; Member since: 12 Oct 2012)
IT IS SO XXXXING FUNNY THAT PHONEARENA ALWAYS TRY TO BE APPLE'S BITCH~ LOOOOL THEY ALWAYS LOOK FOR SOMETHING THAT CAN EFFECT IN NEGATIVE WAY TO SAMSUNG AND THEY NEVER TALK ABOUT LAW SUITS THAT SAMSUNG HAS WON FROM APPLE FROM ALL OVER THE WORLD~ LOOOOL
33. Jobayer (Posts: 167; Member since: 22 Feb 2013)
dam man u caps locked phonearena ? great job, want a sticker ?
89. c.hack (Posts: 603; Member since: 09 Dec 2009)
Get a life. You know Samsuck has to fudge the benchmarks because it caters to specboys who buy on benchmarks and screen size. Despite the cheat even an 8-core Samsuck got blown away by the iPhone 5s.
29. uvaman (Posts: 34; Member since: 14 Jan 2013)
Funny sh***. PA Why you didnt mention others? Anandtech also said Htc, LG, Sony, Nvida cheats too but no lets focus on Samsung only because we "work" for Apple.
32. amasog (Posts: 338; Member since: 22 Aug 2013)
lol! PA mentions only the one that denied! have htc, lg, sony denied? not yet!
use ur brain man!
45. yudi.nemesis (Posts: 1127; Member since: 14 Mar 2013)
Anandtech also said Sony and NVIDIA cheats too???
please read this article correctly!!!
46. Ninetysix (Posts: 2339; Member since: 08 Oct 2012)
It doesn't matter. This article is about Samsung and their response to the entire allegation.
48. boosook (Posts: 1425; Member since: 19 Nov 2012)
I see that samsung fanboys are going mad! :D
35. mrp4ul0 (Posts: 4; Member since: 02 Oct 2013)
Nothing that wasn't expected. It looks like that the only way there is today to say that one phone is better than the other is comparing benchmark results. Every OEM knows how those results are important to some customers so it's only normal everyone will cheat to try and sell another phone. Since almost every OEM does it no need to bash Samsung but they could ar least admit it..
36. dmn666 (Posts: 244; Member since: 19 Oct 2011)
Wish there was a way for Google to whitelist the apps at the OS level. Everyone would be playing fair then. Unfortunately it'll be abused by malware - one disadvantage of the open systems. As far as the reviews go, PA should post the benchmarks with the booster off. Or just ignore it altogether and spend a couple more days and post real life performance ratings which again would end up being subjective sometimes - bummer.
37. MartyK (Posts: 779; Member since: 11 Apr 2012)
Great Write up MH!!..this is pure cheating!!!
Now all we have to do is call ALL companies out when the are doing BS.
38. Altair (Posts: 367; Member since: 02 Feb 2012)
Shamesung on the road again. Where is your morale? It is not enough for you, that you copy everything, you also have to cheat customers.
39. ihabirani (Posts: 2; Member since: 30 Sep 2013)
Samsung remember me of every thing made in china ...
Shame on you cheater
44. woodshop20 (Posts: 459; Member since: 14 Sep 2013)
Everything is made in China. Even Apple.
58. rockblock123 (Posts: 20; Member since: 07 Sep 2013)
hey dumbass!!!apple is made in slave factories in china!!not one part in america..ty for joining the world which is the dumbass iphone lovers who know jack!!ty very much.you for being braindead.
64. Shatter (Posts: 2036; Member since: 29 May 2013)
Moto X is made in the US with parts from... CHINA.
40. newbey123 (Posts: 555; Member since: 19 Mar 2012)
Yes, because cheater always admit to cheating, LOL!! As if, always knew Crapsung was liars and as fake and cheap as their crappy plastic and faux leather.
42. hawkeye7 (Posts: 12; Member since: 19 Jun 2013)
I dont understand why its being blown out of proportion. Giving benchmark tests at maximum utilisation of the CPU means we can understand the limit of the device. Isnt that everyone wants that under heaviest load how much the device perfoms? i feel scores should be calculated for all the devices at maximum loads. whats wrong with that?
43. Ninetysix (Posts: 2339; Member since: 08 Oct 2012)
Note 3 Android 4.3.1 OTA update available.
We noticed that our we missed one benchmark app in our whitelist. Added GFXB 2.7 in the cheat list.
47. Immolate (Posts: 310; Member since: 17 Jun 2011)
Samsung is about as credible here as John V on an Android phone review.
54. Pancholo (Posts: 380; Member since: 27 Feb 2012)
You bunch of bashing fangirls. There are no real, intelligent arguments anymore. This is all I see:
*random fanboy sees random stranger about to buy a Note 3*
Fanboy: Hey! Stop right there!
Consumer: Excuse me?
Fanboy: Yeah, you! Don't buy that!
Consumer: What is your problem? I like it. Why can't I?
Fanboy: Geez! Haven't you heard? Samsung cheats with their phones in benchmark apps!
Consumer: wut? *buys the phone and enjoys life as he knows it, wins the lottery and his life's regrets magically disappear*
Fanboy: Gosh darn it! I need to find more material!
Calm your tits, girls. Technology is awesome, and if it makes you happy, you should get it.
65. Shatter (Posts: 2036; Member since: 29 May 2013)
If Samsung uses it/makes an app its automatically bloatware. If apple or their OEM made the same app it would be amazing software that they always bragged about.
70. ngo2dd (Posts: 896; Member since: 08 Jul 2011)
Expect it has been show time and time again that in the S4 that if disabled the Samsung app the phone run faster. So the phone is bloated with app that make it run slower. So those app turn into bloatware. Man you are one if the biggest shill here.
88. Pancholo (Posts: 380; Member since: 27 Feb 2012)
Let me add quickly that, technically, iOS 7 is also bloatware for the moment being, as it makes your device lag.
Commence the hatin'.
67. procopiojose (Posts: 132; Member since: 26 Oct 2012)
the benchmark tests doesn't really trigger the cpu to "run forrest run" mode. remember that new generation socs implements power-saving features that will consistently give low scores cause it doesn't require all that power to do the tasks.
68. _Bone_ (Posts: 2154; Member since: 29 Oct 2012)
Where even AnandTech is missing the point: Samsung devices do absolutely NOT fake any these results, every benchmark is GENUINE and done by the HW, only these short burst type of apps get an extra kick at the silicon maximum, which is what benchmarking is all about, see it through the end.
I guess when only these apps operate at "100%" and others at "90%", you could feel mad, but the other way to look at it is far more productive: there are thermal and battery benefits at 90%, and the Note 3 is an battery monsterhouse.
The greatest thing Asus ever did was to dowclock the Snapdragon 600 on the Nexus 7, the thing is also battery and buttery smooth. Now is it cheating that with some ROM work you can get it pulling 1.9GHz performance? No, it's just what the HW maximum is, yet a lower clock is a better balance.
It's not cheating if nothing is faked..
91. Jobayer (Posts: 167; Member since: 22 Feb 2013)
yea r8, whatever helps u sleep at night man >_<
84. nothingmuch (Posts: 189; Member since: 03 May 2013)
""FlexRender is designed to help the Adreno GPU boost speed and save power by dynamically switching between drawing pixels in direct or deferred rendering mode""
^^^this is just one of the comments listed on this site, isn't the GPU just one of the things that these benchmarks test??? just think of what else the processor can help itself boost!
now think on this for a minute if Samsung claims that they didn't cheat maybe they didn't, just maybe that the "white list" might be on the processor itself..... now wouldn't that be some sh**!
Again which major brands are being accused of the same thing? Hmmmm....with the same chip? kinda obvious here that the source of the "boosting performance" might be in the processor itself, not the one who incorporates it.
87. yudi.nemesis (Posts: 1127; Member since: 14 Mar 2013)
So now you blaming the chipset??
Maybe you can explain to me why? Nexus and Motorola devices with the same Qualcomm chipsets not have “Boosting Performance” in android benchmark.
100. Trex95 (Posts: 879; Member since: 03 Mar 2013)
They will keep lies till they will believe there lies lol.
101. Ronny666 (Posts: 111; Member since: 08 Jun 2013)
We are unable to detect this in iphones mainly because it is running on closed operating system unlike androids. Most OEMs optimise their devices for benchmarking apps so that it can display the full potential of their hardware. That's not called cheating unless if they overclocked it higher than the advertised speed mainly for benchmarking tools.
In Samsung's case, the GPU does hit at the highest frequency when running certain apps not just benchmark apps but most of the time it runs on lower frequency so that it doesn't generate too much of heat and suffer shorter life span. The normal GPU speed is adequate for running most applications even graphic extensive games.
The basic thing that Anandtech missed out is, benchmark results does not directly translate to real-world usage.
If you are on dope then u r cheating but if you are wearing feather light spikes in a competition to perform better than your usual training, then it is not called cheating.
102. remixfa (Posts: 14255; Member since: 19 Dec 2008)
Its been a while since I've posted. So I figured this would be a good thread to visit.
I just wanted to point out that I called Samsung and a few others out on cheating 2 YEARS AGO.
Way to go, finally catching up! lol.