Samsung denies cheating on benchmark tests

The evidence seems pretty hard to argue, but Samsung wants to try anyway. Multiple sources have found that Samsung (as well as most other Android manufacturers) artificially boost CPU frequencies when the system detects a benchmarking test running. Samsung is denying that its devices are trying to cheat the tests, and is actually putting the blame on the tests themselves...
This is a discussion for a news article. To read the whole news, click here

102 Comments

1. AfterShock

Posts: 4146; Member since: Nov 02, 2012

Just like former world class atheletes., I didn't dope! Right.

15. androiphone20

Posts: 1654; Member since: Jul 10, 2013

cheaters never die

49. Commentator

Posts: 3722; Member since: Aug 16, 2011

Ryan Braun would fit in just fine as their spokesman.

55. LG_is_the_best unregistered

Cheaters never lose, and losers never cheat

62. Kan_wha

Posts: 88; Member since: Jun 25, 2012

Liar liar pants on fire! lol

95. chocolaking

Posts: 495; Member since: May 22, 2012

samsung = more lies

71. JC557

Posts: 1918; Member since: Dec 07, 2011

Take a look at the Anandtech article on this. It's pretty evident that all OEMs have some cheats up their sleeves so Samsung shouldn't be so quick to deny it. http://anandtech.com/show/7384/state-of-cheating-in-android-benchmarks

74. yudi.nemesis unregistered

At the Anandtech article “ONLY” Samsung, Asus, LG, and HTC is proven of cheating in android benchmarks.

76. joey_sfb

Posts: 6794; Member since: Mar 29, 2012

WELCOME! to the Samdung Hate Group Gathering. Have a Samdung today!! Everyday!

83. JC557

Posts: 1918; Member since: Dec 07, 2011

That leaves only Motorola and Nexus branded phones... though one could argue that it's just Google that's not cheating as Moto belonogs to them now. No Sonys on the chart so it remains to be seen, but pretty much all major OEMs "optimize" a bit while some go too far.

86. JC557

Posts: 1918; Member since: Dec 07, 2011

About the Note 3, I'm curious if the increase in thermal headroom has anything to do with better benchmark scores. The CPU and GPU might be able to run a bit less restricted.

90. yudi.nemesis unregistered

*Motorola, Nexus, and NVIDIA. *“ALMOST” all Android OEMs.

80. blazee

Posts: 414; Member since: Jan 02, 2012

This just further solidifies my choice in only getting nexus devices. Google seems to be trying to create a great user experience rather than try to deceive and cheat to sell their devices. Sad that there might be time wasted before rolling out a system update because of optimization and tweaking solely to achieve higher benchmark scores by some manufacturers.

85. JC557

Posts: 1918; Member since: Dec 07, 2011

There's an alarming amount of Samsung apologists... seems like they're on their way to becoming what they accuse Apple users of. Every OEM needs to be scrutinized since consumers and not bah bahs should control the market trends.

2. Ninetysix

Posts: 2933; Member since: Oct 08, 2012

BS again. If that was the case, the gpu/cpu speeds should be the same EVEN if you rename the application.

3. datsyuk

Posts: 180; Member since: Jan 11, 2012

In other words they only "maximize" the CPU/GPU on benchmark tests.

41. PhoneArenaUser

Posts: 5498; Member since: Aug 05, 2011

Agree, Samsung didn't fake benchmark results, only "boosts" the CPU/GPU on benchmark tests. So on the one hand it is not cheating because results are real. But on the other hand it still tricks user to think that CPU/GPU always runs with high performance but it is not true, CPU/GPU runs full power only with benchmark apps.

50. Shatter

Posts: 2036; Member since: May 29, 2013

This is like Intels turbo boost. It is not cheating it just boost performance when needed if the chip is at good temperatures. Samsung could shut everyone up if they added to the specs sheet with "SBoost" up to 2.5ghz in applications that need it or whatever.

60. PhoneArenaUser

Posts: 5498; Member since: Aug 05, 2011

"Samsung could shut everyone up if they added to the specs sheet with "SBoost" up to 2.5ghz in applications that need it or whatever." Actually Samsung already made such list, but the problem is that on this list is only benchmark applications and that's why now we see such scandal about cheating.

73. tedkord

Posts: 17117; Member since: Jun 17, 2009

That's not what happens. They don't overclock, they just ramp the CPU/GPU to max for the test, rather than letting the app load determine the speed. It's not technically a cheat, a cheat would be giving a false number that it didn't achieve. It's more of a best case scenario. But it's misleading, so I have no problem with the word cheat.

52. HansGoneInsane unregistered

But you said yourself that Samsung tricks his customers by creating the illusion that they could get the same performance when not running benchmarks. The word "trick" is a synonym for the word "cheat". In other words: Samsung cheats on his customers by purposely creating wrong impressions of its products.

61. Shatter

Posts: 2036; Member since: May 29, 2013

They trick their customers with ads and everybody fakes benchmarks because idiots believe phones are only as good as their benchmarks show. The only benchmarks should be real world performance ones like how much FPS a game gets or how fast a zip files compresses or how quick it can encode a video. Artificial benchmarks like antutu give you a false idea of how powerful a device is. Some roms have the Samsung cpu auto overclock crap deleted and it makes benchmark scores drop but the device will be much more smooth/efficient with all the optimization and such. There are also roms that target benchmarks to give you higher scores so you can feel better about yourself if your one of those people.

66. PhoneArenaUser

Posts: 5498; Member since: Aug 05, 2011

Samsung didn't fake benchmark results, CPU/GPU really achieves such results. The problem is that user by default can't achieve such CPU/GPU power while using other games and applications. CPU/GPU runs full powe only with benchmark applications which are specified on the list. It is like a cars engine with limiter which restrict engine's maximum rotational speed. Car really can go faster just need to remove limiter. Anyway, I agree that such things sucks! :(

75. tedkord

Posts: 17117; Member since: Jun 17, 2009

They don't only run full tilt then. Any good benchmark should taboo them to full anyway. If an app or game doesn't, it's because it doesn't need it.

4. LordDavon

Posts: 152; Member since: Sep 19, 2011

Well then. That's that! /s

5. LAKAME_MAN

Posts: 46; Member since: Jan 31, 2013

And we sooo believe them :|

7. Ninetysix

Posts: 2933; Member since: Oct 08, 2012

Yes. Just wait a little longer for the Samsung herd to post. It'll come....trust me :) edit: Post #6 is one

6. grahaman27

Posts: 364; Member since: Apr 05, 2013

I agree with Samsung. Its not cheating.

19. androiphone20

Posts: 1654; Member since: Jul 10, 2013

oh please

27. Jobayer

Posts: 167; Member since: Feb 22, 2013

fan boy alert !
This copy is for your personal, non-commercial use only. You can order presentation-ready copies for distribution to your colleagues, clients or customers at https://www.parsintl.com/phonearena or use the Reprints & Permissions tool that appears at the bottom of each web page. Visit https://www.parsintl.com/ for samples and additional information.