Huawei justifies pumping benchmark scores, and you won't believe the reason (UPDATED)

Huawei justifies pumping benchmark scores, and you won't believe the reason (UPDATED)
UPDATE: Huawei sent us its own take on the matter, which we are providing in full below, saying that the Performance Mode that gets triggered by benchmark apps would be made available to its phone users to turn on if a situation demands it:



"Everybody is doing it, so why can't we?" Besides the first studio album of The Cranberries, this was Huawei's justification when they were shown to swindle popular benchmark apps. 

It's not the first time a manufacturer is found to ditch their power draw/performance barriers and turn off thermal throttling for the processor when their phones recognize the likes of Geekbench, AnTuTu, or other benchies being run. Here's how Honor does it in GFXBench with its new Play gaming phone that we reviewed last week, according to AnandTech:


As you can see, all thermal runaway precautions are taken off when the phone detects the benchmark software being run, while when that variable is switched on, the score is much lower, and the power consumption of the chipset, too.


Pressed for an answer, Dr. Wang Chenglu, Huawei's President of Software, noted that synthetic benchmarks are increasingly drifting away from being representative of real-world usage, yet they are widely used from reviewers and the general public to gauge a handset's performance. This Catch 22 has forced Honor to play the same game with its Play phone as most major Chinese manufacturers, the vast majority of which pump up the benchmark scores in a similar manner.

AnTuTu Higher is better
Honor Play 204779
Honor 10 196732
OnePlus 6 260353.5
Razer Phone 178121
JetStream Higher is better
Honor Play 56.253
Honor 10 45.875
OnePlus 6 88.123
Razer Phone 60.199
GFXBench Car Chase on-screen Higher is better
Honor Play 22
Honor 10 20
OnePlus 6 30
Razer Phone 15
GFXBench Manhattan 3.1 on-screen Higher is better
Honor Play 38
Honor 10 34
OnePlus 6 50
Razer Phone 22
Geekbench 4 single-core Higher is better
Honor Play 1897
Honor 10 1897
OnePlus 6 2413.66
Razer Phone 1923
Geekbench 4 multi-core Higher is better
Honor Play 6618
Honor 10 6515
OnePlus 6 8929
Razer Phone 6721

Long story short, while there are users that judge a phone's daily performance by its synthetic benchmark numbers, there will be cheating involved, and companies seem pretty unapologetic about it.

source: AnandTech

FEATURED VIDEO

Latest Stories

This copy is for your personal, non-commercial use only. You can order presentation-ready copies for distribution to your colleagues, clients or customers at https://www.parsintl.com/phonearena or use the Reprints & Permissions tool that appears at the bottom of each web page. Visit https://www.parsintl.com/ for samples and additional information.
FCC OKs Cingular's purchase of AT&T Wireless