Huawei justifies pumping benchmark scores, and you won't believe the reason (UPDATED)

Huawei justifies pumping benchmark scores, and you won't believe the reason (UPDATED)
UPDATE: Huawei sent us its own take on the matter, which we are providing in full below, saying that the Performance Mode that gets triggered by benchmark apps would be made available to its phone users to turn on if a situation demands it:



"Everybody is doing it, so why can't we?" Besides the first studio album of The Cranberries, this was Huawei's justification when they were shown to swindle popular benchmark apps. 

It's not the first time a manufacturer is found to ditch their power draw/performance barriers and turn off thermal throttling for the processor when their phones recognize the likes of Geekbench, AnTuTu, or other benchies being run. Here's how Honor does it in GFXBench with its new Play gaming phone that we reviewed last week, according to AnandTech:

Huawei justifies pumping benchmark scores, and you won't believe the reason (UPDATED)

As you can see, all thermal runaway precautions are taken off when the phone detects the benchmark software being run, while when that variable is switched on, the score is much lower, and the power consumption of the chipset, too.


Pressed for an answer, Dr. Wang Chenglu, Huawei's President of Software, noted that synthetic benchmarks are increasingly drifting away from being representative of real-world usage, yet they are widely used from reviewers and the general public to gauge a handset's performance. This Catch 22 has forced Honor to play the same game with its Play phone as most major Chinese manufacturers, the vast majority of which pump up the benchmark scores in a similar manner.

AnTuTu Higher is better
Honor Play 204779
Honor 10 196732
OnePlus 6 260353.5
Razer Phone 178121
JetStream Higher is better
Honor Play 56.253
Honor 10 45.875
OnePlus 6 88.123
Razer Phone 60.199
GFXBench Car Chase on-screen Higher is better
Honor Play 22
Honor 10 20
OnePlus 6 30
Razer Phone 15
GFXBench Manhattan 3.1 on-screen Higher is better
Honor Play 38
Honor 10 34
OnePlus 6 50
Razer Phone 22
Geekbench 4 single-core Higher is better
Honor Play 1897
Honor 10 1897
OnePlus 6 2413.66
Razer Phone 1923
Geekbench 4 multi-core Higher is better
Honor Play 6618
Honor 10 6515
OnePlus 6 8929
Razer Phone 6721

Long story short, while there are users that judge a phone's daily performance by its synthetic benchmark numbers, there will be cheating involved, and companies seem pretty unapologetic about it.

source: AnandTech

FEATURED VIDEO

22 Comments

1. Papa_Ji

Posts: 769; Member since: Jun 27, 2016

Atleast android OEM (other than google) are caught due to open source android. Huawei and others are just cheating benchmark but.... Who knows what the S**t apple (and even google) is doing under the hood... In thre completely closed OS. APPLE AND GOOGLE ARE THREAT TO EVERY Country SECURITY.

3. dimas

Posts: 3247; Member since: Jul 22, 2014

Damir Franc is right on calling out Huawei/ Honor on their marketing bulls**ts. 4D Display? Are we going to do time travel and s**t with their phone? Lol.

4. Bondurant

Posts: 758; Member since: Jun 04, 2014

You mean the opinion of that guy who gives positive review only for below 300$ phones which he can afford.

9. dimas

Posts: 3247; Member since: Jul 22, 2014

Who cares if he only review affordable phones? He is one of the most honest reviewers in youtube. He's not sugarcoating from affordable to flagship phones. Salty people are salty.

5. Bondurant

Posts: 758; Member since: Jun 04, 2014

.......

18. Leo_MC

Posts: 6300; Member since: Dec 02, 2011

I have taken my iOS device to the repair shop and they have found a little china man, playing checkers behind the RAM with a little us man...

2. dimas

Posts: 3247; Member since: Jul 22, 2014

Great answers always come from Huawei. That's how to get banned in Japan next after US and Australia.

17. Aruminiumaian

Posts: 209; Member since: Jul 22, 2017

I won't be surprised if Japan kicks out Huawei entirely out of the country, they follow every order US gives them and do literally everything US does. They don't think by themselves when doing some new stuffs.

6. Bondurant

Posts: 758; Member since: Jun 04, 2014

Calling it cheating is subjective to what benchmarks are meant to show. Real world performance or maximum performance achievable.

10. dimas

Posts: 3247; Member since: Jul 22, 2014

Hey wise guy, you don't read the article? Huawei just said that "everybody's doing it so we are also doing it." That's not something you want to hear from a "trustworthy" company, yes? Take off your fanboy helmet and use logic.

14. Bondurant

Posts: 758; Member since: Jun 04, 2014

And why is everyone doing it despite being caught several times ? Cause its justifiable, smarty pants.

21. Techist

Posts: 311; Member since: Jan 27, 2015

Agreed! By way of example, Usain Bolt doesn't always move around at top speed in his day to day life. That is reserved for competitive races. Same idea could be applied to all sorts of other scenarios. I see no reason why phones shouldn't be allowed to exhibit their top performance in benchmarks designed to measure that, whilst having other benchmarks that are designed to measure normal daily usage metrics.

22. AfterShock

Posts: 4146; Member since: Nov 02, 2012

What if you actually bought it to game as they tweaked it to and it fails or starts eating battery like an Intel soc but giving worse performance then others at same or similar pricing. A sham, yeah that's what being said.

7. Bondurant

Posts: 758; Member since: Jun 04, 2014

........

8. moslondon

Posts: 40; Member since: Mar 07, 2013

I have the oneplus 6 8gb ram. I have run antutu getting 280000 score, no i dont have root or anything like that

11. medtxa

Posts: 1655; Member since: Jun 02, 2014

Feel cheated on benchmark is like feel cheated on the biggest junk competition, if you care it's only show how stupid you are.

12. medtxa

Posts: 1655; Member since: Jun 02, 2014

Feel cheated on benchmark is like feel cheated on the biggest junk competition, if you care it's only show how stupid you are.

13. medtxa

Posts: 1655; Member since: Jun 02, 2014

Feel cheated on benchmark is like feel cheated on the biggest junk competition, if you care it's only show how stupid you are.

16. Aruminiumaian

Posts: 209; Member since: Jul 22, 2017

It still doesn't change the fact that the company intentionally tried to deceive us for their own good.

15. Aruminiumaian

Posts: 209; Member since: Jul 22, 2017

This is purely disgusting, but I'm not surprised at all lol. Many large companies including Samsung, Sony, OnePlus and HTC have cheated in benchmarks before, so why not Huawei too? Seriously though, we should all stop trusting all those benchmark numbers so blindly! No matter the reason we can't let those companies deceive us, ever.

19. japkoslav

Posts: 1332; Member since: Feb 19, 2017

I can't believe someone is that plain STUPID. I mean china market, china market, china market ... who cares? Who cares no-name brands are worse? Just release your cheating firmware for china (if you really "have to") and give decent firmware to the rest of the world. Not a perfect solution, but it sure as hell is less STUPID. Not even Meizu, Samsung, OnePlus and others were so stupid to cheat for more than 5-10% boost. On the other hand ... those who swear by benchmarks ...

20. AfterShock

Posts: 4146; Member since: Nov 02, 2012

By using false narratives they have enjoyed a plethora of free media over gpu boost and new SOC. This is where there real damage is, turning social media against actual good equipment from competition because of Grand delusions by an OEM that hasn't been caught cheating end users yet. Had hope for some OEM breaking new ground, but over promising then under delivering is a scam through and through.

Latest Stories

This copy is for your personal, non-commercial use only. You can order presentation-ready copies for distribution to your colleagues, clients or customers at https://www.parsintl.com/phonearena or use the Reprints & Permissions tool that appears at the bottom of each web page. Visit https://www.parsintl.com/ for samples and additional information.