The OnePlus 5 cheats in benchmarks, just like those before it (Update - co-founder responds)

It looks like OnePlus is back to its old tricks with the new OnePlus 5, for XDA Developers caught the handset with a bit of virtual 'doping' during benchmarks...
This is a discussion for a news article. To read the whole news, click here

83 Comments

27. justrt

Posts: 446; Member since: Jul 10, 2014

They cheated so much, that their way became the standard. :p Now, if your phone's benchmark scores low, you are doing something wrong.

28. jeroome86

Posts: 2314; Member since: Apr 12, 2012

Ahhhhhhhhh. PROOF READ. Please!

35. omnitech

Posts: 1131; Member since: Sep 28, 2016

I don't get all this cheating talk. This is like a power lifter seeing what their max is at one rep. Just because they can't do 10-15 reps doesn't mean they didn't actually lift that weight. If they did their max, they did their max. If Oneplus 5 couldn't do that benchmark it would just crash or blowup or drain the battery from 100-0 in 1 second flat. But no it can run the benchmark app just fine with full performance on. What's the issue here? If this is cheating, then Apple is cheating even more by pretending IOS and a 750p display is as processor intensive as Android and a 2k display.

36. omnitech

Posts: 1131; Member since: Sep 28, 2016

That said, everybody optimizes or cheats anyways, I mean, the SD835 with 4gb of ram is the SD835 with 4gb of ram. They technicall should all bench exactly the same but the scores are widely different. This isn't like cars where the weight of the car and aerodynamics affect performance. Only thing that should affect it is screen resolution and even then the off screen tests should be exactly the same and not widely different.

46. ibend

Posts: 6747; Member since: Sep 30, 2014

you forgot that some UI is heavier than other (compare touchwiz to vanilla android).. and each phone type has different number of apps/services running in background.. different storage type, different RAM type, different mainboard, etc "Only thing that should affect it is screen resolution and even then the off screen tests should be exactly the same" try to run benchmark twice on your smartphone, it wont give you exact same score.. or try to run geekbench on windows10 vs linux, the score gap is huge.. (I tried it with the exact same rig, and same SSD as boot disk.. and ubuntu won with 20% higher score)

74. omnitech

Posts: 1131; Member since: Sep 28, 2016

No one should care though. If you want best performance you can run an i7 with 8gb on MS DOS, but no one wants MS DOS. That's why IOS benches so high, it's so bare bones it's ridiculous. When I test an engine I test an engine. If I want to test software I wouldn't look at benchmarks. My only concern is what an SD835 can do, not how streamlined MS DOS is.

39. GREATexpectations

Posts: 16; Member since: Jun 20, 2017

"Furthermore, benchmark cheating doesn't go especially well next to dropping support for the less than two years-old OnePlus 2, yearly price increase, and nabbing Apple's iPhone 7 Plus design when it comes to improving OnePlus' public image..." How is this in any way an objective piece of writing? Does journalistic objectivity and professionalism not mean anything to you? With the overly blatant negative connotations, this article comes across as nothing more than a fanboy rant. I find the fact that PhoneArena has yet to post a launch day review of Oneplus 5, unlike other news outlets, rather suggestive......

42. fyah_king unregistered

They didnt do the review because they thought oneplus 5 is/was an iphone 7 plus. Even though Oneplus is smaller, slimmer and the back only has slight similarities.

41. fyah_king unregistered

Now that I've seen it on YouTube. The one plus backside doesn't really look like the 7plus.

43. tangbunna

Posts: 446; Member since: Sep 29, 2016

I like that nitro boost switch. unlike others big head small butts, only keep throttling the speed.

44. davthom123

Posts: 117; Member since: Mar 02, 2015

most benchmarks are used to show peak not actual performance which is why anandtech also perform tests to check for performance once throttling kicks in.but since sites like pa concentrate on peak performance benchmarks I guess this irks them somehow

45. R3DgRu

Posts: 55; Member since: Jun 10, 2015

That's great, then we see what sd835 is capable of. Thats what benchmarks are for.

47. ibend

Posts: 6747; Member since: Sep 30, 2014

it's just worse than cheating score... they push that processor to the limit to get high bench score.. but throttle for daily usage to get better battery life.. and they use that better battery life as excuse to use small battery and make device "uselessly" thinner. kinda like car manufacturers cheating in MPG test, performance test, and emission test.. they use different tuning for each of those test.. average users wont even care about this stuff.. but enthusiast really hate this stuff

48. Shubham1221

Posts: 153; Member since: Jul 29, 2015

No Dxo mark score for OP5 yet.Also no one mentions Dxo on launching event.Is it a false rumors that Dxo is taking care of Op5 camera.

50. Lumberjack

Posts: 306; Member since: May 04, 2017

DxO is not taking care of it. It is advices. What is good and was had to be improved. I do not expect anything above 84

52. TechieXP1969

Posts: 14967; Member since: Sep 25, 2013

I agree with the Co-Founder. Its not cheating unless the chips are being ran above their native clocks, which Samsung, OnePlus or no one else has ever done. Anyone who cries fowl is a complete fool. The whole point of a benchmark is to see how powerful a computer is. Benchmarks cannot give true daily performance due to several variables. The main variable is the fact no to peoples phone will be 100% identical. Thus each persons performance will be different. Even in Windows, when you launch an app or benchmark, the cores are pushed to full and then they idle. This is normal computing. Its like a car race. Cheating in a car race would be doing something that exceed the native performance. Making cores run at full clock is not cheating because at some point you do use them all at full tilt. Whether it stays sustained depends on what you are doing., The main reason this is consider not real is because, the full speed doesn't run constant.

62. adi90

Posts: 554; Member since: Dec 21, 2015

" Whether it stays sustained depends on what you are doing" This is the million dollar question, These benchmarks show that these chips are actually capable to do so. Will the chip sustain itself at full clock speed for so long in the hands of a user? Their is a big difference between a chip running at full clock speed for 95% and 24.4% of the time. What if a user wants it to run for 95% of the time. Will it run for that long or throttle itself much earlier.

75. omnitech

Posts: 1131; Member since: Sep 28, 2016

It all depends on what you think a benchmark is meant to do or portray. If it's simply to show pure muscle mass, like I believe what a benchmark is, it's not cheating in the slightest. Muscle mass is muscle mass that can be quantified just like these numbers are quantifiable. Technically it's not running at 100 miles per hour and the odometer is set to show 200 miles per hour. That's cheating,. It's running 200 miles per hour just like it says it is. When I look at benchmarks or horse power I am looking for the peak. Yes you can't run the peak 95% of the time without throttling but it's still nice to know. If you ever need that performance in an apocalypse, macgyver or geek situation, you can achieve its peak by putting it in ice water and attaching it to a laptop battery or a huge 10000 mah tablet battery then it will theoretically be able to reach that performance 95% of the time. That's the only thing a benchmark is good for imo. Nothing is meant to maintain its peak 95% of the time. There are much better ways to test everyday performance than a benchmark.association. If I wanted to test 95% of the time everyday use I defitnitely wouldn't use a benchmark to guide me, lol I would buy it at bestbuy, use it, and return it after the 14 day window or keep it. That's how you test everyday use. I don't freaking look at geekbench......

80. adi90

Posts: 554; Member since: Dec 21, 2015

There is a general conssensus developed over the years that based on benchmarks people can judge the performance of a device. Maybe it does not matter to you. But there are still many people ,especially in countries like china and india (major market for oneplus) where people comapre benchmarks before finally purchasing a device. That is why manufacturer who try to artificially boost its benchmark are being criticized. Beacuse it mislead the consumers. Now you may say that they are fools . That is a different thing.

54. kevin91202

Posts: 640; Member since: Jun 08, 2014

Too bad this article is filled with grammatical and spelling errors and odd use of words.

63. tokuzumi

Posts: 1800; Member since: Aug 27, 2009

Benchmarks haven't been relevant since 2010. Even when Samsung was busted for "cheating" on benchmarks, they didn't stop. Look how that has effected their sales. Maybe 1% of people care about benchmark scores.

76. omnitech

Posts: 1131; Member since: Sep 28, 2016

The more I think about it, accusing Android handsets of cheating is just another product of an Apple shill media editor firing a shot at Android.

77. Ninetysix

Posts: 2933; Member since: Oct 08, 2012

Exactly. XDA is full of Apple users.
This copy is for your personal, non-commercial use only. You can order presentation-ready copies for distribution to your colleagues, clients or customers at https://www.parsintl.com/phonearena or use the Reprints & Permissions tool that appears at the bottom of each web page. Visit https://www.parsintl.com/ for samples and additional information.