Samsung putting an end to benchmark cheating with the KitKat update for Galaxy S4 and Note 3
1. NoFanboy (Posts: 252; Member since: 18 Nov 2013)
News: Samsung finds more advanced way of cheating on benchmarks that has yet to be discovered
4. tech2 (Posts: 2573; Member since: 26 Oct 2012)
Give credit when its due. Almost all companies cheat but Samsung is the one to stop first. Still people like you find a reason to complain.
Haters gonna hate. smh
6. AliNSiddiqui (Posts: 382; Member since: 19 Sep 2012)
Don't be naive man.. NoFanboy has good reason to be wary of Samsung from now on..
8. joey_sfb (Posts: 3504; Member since: 29 Mar 2012)
Full speed at bench mark is normal.
Being doing on the first x86 system since the NEC V20 chip. Its my first overclocked x86 cpu.
14. itsdeepak4u2000 (Posts: 3059; Member since: 03 Nov 2012)
This is very true: "everyone wants their product to be at its best when tested"
so does Sammy and why not? But KitKat update is very good for stopping such things. But but but I think Sammy will somehow find a alternative for this too. ;)
Bring it on Sammy. :)
18. tech2 (Posts: 2573; Member since: 26 Oct 2012)
Re-read the article. Its not Kitkat its Samsung who is putting this to an end.
20. itsdeepak4u2000 (Posts: 3059; Member since: 03 Nov 2012)
Oh really? Don't tell me this, please read second paragraph's first sentence.
28. shahrooz (Posts: 247; Member since: 17 Sep 2013)
You don't know what open source means, do you?
2. XaErO (Posts: 205; Member since: 25 Sep 2012)
Excellent !! .. That should be a close demonstration to real world usage !!
17. livyatan (Posts: 772; Member since: 19 Jun 2013)
Nope..my Note 3 on KitKat still destroys every bench.
35 200-36 300 on AnTutu, 26 fps on TRex, etc..
5. Diezparda (Posts: 244; Member since: 23 Oct 2013)
why rely on benchmarking test? i think the actual performance that really matter.
7. _Bone_ (Posts: 2142; Member since: 29 Oct 2012)
I never considered it cheating since benchmark results were always REAL even if the extra performance was only allowed for a handful of apps (including S appa). The point for benchmarking is to "see the end" so modders, the only ones who should really care, to see how far they can tweak their ROMs once they get into the SoC.
Or ask yourself this: if an XDA developer comes out with a tweaked ROM performing extra benchmark performance - is that cheating too? But for the unqualified crowd, Samsung and LG are doing the right thing to step back to stock clocks (or is it KitKat limitations?)
9. superduper (Posts: 151; Member since: 20 Oct 2013)
Not sure how this can't be called cheating. The offending devices were even delisted from some benchmark websites because the benchmark owners felt they were cheating and damaging the integrity of the benchmark.
Kudos to Anandtech for calling Shamesung out on this cheating.
12. tedkord (Posts: 5538; Member since: 17 Jun 2009)
Here's why. I have an AOSP rom on my Samsung device, so I don't have the benchmark app that Samsung included. I sideloaded an app that overlays both core speeds in the screen at all times then fired up Quadrant and AnTuTu. Guess what? Both cores pegged at top speed the whole run.
A good benchmark is supposed to stress your device. If it doesn't, it's useless.
10. pwnarena (Posts: 1001; Member since: 15 Feb 2013)
PA, yes it's called cheating because those full performances could not be achieved in real world usage. they are only activating the full potential of the devices when there is benchmark testing.
if they are confident with the performance of their devices, they shouldn't be throttling them. what are they worried about? heating issues? instability?
13. tedkord (Posts: 5538; Member since: 17 Jun 2009)
Yes, those full performances can be achieved in real world usage. They didn't overclock the CPU, the didn't boost the bus speed or access hardware that is normally dormant.
A benchmark is supposed to stress your device. If your device isn't running at full tilt during one, the bench isn't trelling you anything useful.
22. joey_sfb (Posts: 3504; Member since: 29 Mar 2012)
These mobile crowd never build their own DIY x86 PC before.
Benchmark is supposed to stress the system to ensure the system is stable under all conditions and prolonged period.
Anyway, every brands do it not only Samsung but the hater are ready to pound on anything Samsung. Quite cute actually because in the end Samsung brand sell and they remain bitter. Lol!
16. asingha94 (Posts: 294; Member since: 08 Apr 2012)
lol!!still inside!!they just find a better way!!
15. kanagadeepan (Posts: 737; Member since: 24 Jan 2012)
So in 4.3 or below, if we keep the Benchmark app running / waiting in BackGround, then the phone's battery will die very very fast?? Isn't it?
Well, whether 4.4 stops this mischief or Sammy got bored of cheating??? Credit to Google or Sammy?
19. Tsepz_GP (Posts: 865; Member since: 12 Apr 2012)
The funny part is that my GS4 Octa on 4.4.2 scored more than it did in 4.3, I now get +28800, that's around the same as what I got in 4.2.2 before the benchmark boosting was exposed, in AnTuTu.
24. mike2959 (Posts: 299; Member since: 08 Oct 2011)
The real deal here is Kit Kat. On every device before and after the update, synthetic benchmarks are lower.
27. galanoth07 (Posts: 44; Member since: 23 Jan 2014)
they shoud put more details when it comes to benchmarkings like benchmarking a CPU/GPU.