x PhoneArena is hiring! Reviewer in the USA

Browser Wars: Speed & Benchmark comparison

Posted: , by Ray S.

Tags :

Browser Wars: Speed & Benchmark comparison
It's been a while since we last compared the marvelous mobile web browsers that we have at our disposal. So, after many new versions and updates, as well as entirely new offerings in the area, we decided it's finally time to put the leading browsers through their paces.

We decided to make a speed (page loading) and benchmark browser comparison featuring the following contenders...


THE CONTENDERS

  • ICS Stock
  • Chrome
  • Firefox
  • Dolphin
  • Opera Mobile
  • Safari


THE RULES

The first test in the comparison has to do with speed! We're comparing the time needed for all browsers to load a set of web pages. With each browser, we loaded every page three times, with the first time being performed after a restart of the device. The purpose of this is to take into account both first-time and consecutive loading times of the web pages. In the first table below, you'll see the average timing achieved by each device for every page, as well as an average time figure, which is the average of the device's timing for all four pages.

The phone we used for the tests was the Samsung Galaxy S III with Android 4.0.4 ICS. Safari was tested using the Apple iPhone 4S.

All tests were made with Flash turned off in all browsers. Both the Galaxy S III and iPhone 4S were connected to the same Wi-Fi network and positioned at the same distance from the hotspot.

In the second test, we ran the BrowserMark and Ringmark benchmarks on all six browsers. When completed, BrowserMark returns a single "Score" number, while Ringmark shows the number of supported web features and successfully completed tests. Please bear in mind that such kinds of synthetic benchmarks don't always represent the browser's real-world performance.


TEST #1: PAGE LOADING TIMES

Although some may find it hard to believe, our first test proved that Chrome for Android isn't the ultimate go-to mobile browser. At least, not yet. With Ice Cream Sandwich, Google made some tremendous improvements in the system's stock browser, and it looks like this piece of software still isn't willing to step aside and surrender its place to Chrome. Most of the times, the stock ICS browser managed to slightly outperform Chrome, which practically guaranteed it the top spot, shared with Safari. Chrome took the silver with a convincing average result of 9.2 seconds, followed by Firefox and Dolphin. Opera Mobile finished far behind its competitors, but we should note here that the browser loaded the pages almost fully, and was perfectly operational, even though the progress bar stayed at about 90% for a long time. Nevertheless, since we are measuring the time it takes for the browsers to completely load a page, Opera Mobile's results ended up quite poor.

We'd also like to mention that we experienced no failed loading attempts with the iPhone 4S's Safari. With pretty much all other browsers, there were times when the loading progress would just stuck, or the page would not start to load at all, or would take suspiciously long to load completely. We have not taken those failed attempts into account for the the results that you see below.



PhoneArena.com (seconds) NYTimes.com
(seconds)
NationalGeographic.com
(seconds)
Imdb.com
(seconds)
Average
(seconds)
Android ICS Stock 11.9 7.6 9.4 4.1 8.2
Chrome 16.6 9.6 6.5 4.2 9.2
Firefox 15.3 9.6 10.5 7.6 10.7
Dolphin 18.9 13.8 10.3 4.2 11.8
Opera Mobile 16.3 27.5 22.3 9.7 18.9
Safari 12 6.5 10 4.4 8.2
* Lower is better


TEST #2: BENCHMARKS

You just can't make a comparison nowadays without checking out the benchmark numbers. Although we all know that these scores don't necessarily represent the browsers' real-world performance, we're relatively convinced that the numbers do stand for something, although it isn't perfectly what it is. The philosophy behind Ringmark is a step in the right direction, as it simply checks if a browser supports a number of basic and advanced technologies, including HTML 5. It's worth noting that many of these advanced browser/web technologies aren't needed for a full browsing experience yet, but some of them will probably become popular in the near future. Once again, before we go on with the scores themselves, what the Ringmark figures represent is the number of supported web features and successfully completed tests.



BrowserMark
(score)
Ringmark
(features / tests)
Android ICS Stock 167134 56 / 237
Chrome 158902 56 / 258
Firefox 75911 26 / 101
Dolphin 102398 56 / 237
Opera Mobile 44733 26 / 101
Safari 87231 56 / 251
* Higher is better


CONCLUSION

The tests we did kind of proved what we have previously observed when using these most popular mobile browsers. The stock Android browser in ICS is still a bit faster and smoother than Chrome in most situations, but this doesn't really matter much, as we know that Google is phasing it out, and replacing it with Chrome in Jelly Bean. The rest of the Android gang is also very strong, with Firefox trying to close the gap with the others, and Dolphin still holding strong positions. At this point, it is mostly a matter of which experience suits you best, with some small exceptions. Meanwhile, Apple seems to be doing a good job of keeping Safari on par with the best Android browsers, mixed with the traditional top-notch stability found in iOS.

At the end of the day, it becomes evident that there currently isn't a definite leader in the mobile browsing space, which is a good thing, because it will keep all parties motivated to improve and innovate their offerings.

Which is your current browser of choice? Do you plan to change it after seeing these results? Feel free to sound off in the comments!

68 Comments
  • Options
    Close






posted on 21 Aug 2012, 09:53 19

1. POLICE (banned) (Posts: 61; Member since: 21 Aug 2012)


But was the S3 on flight mode when doing the test?
Cause its a full OS it has so many apps running at the background, where's iP4s has few apps running.

posted on 21 Aug 2012, 10:01 21

3. bucky (Posts: 2698; Member since: 30 Sep 2009)


Lol maybe we should check the temperature and humidity scale for that day as well. I think there was a full moon which would definitely hamper results.

We clearly need a re-test.

Nice to see that there a bunch of great choices.

posted on 21 Aug 2012, 10:08 4

6. taz89 (Posts: 2014; Member since: 03 May 2011)


lol agree 2 different os so its never going to be possible to do a true comparison...alos even if the s3 oe any android phone was offline there will always be background app they just wont be able to connect to data..these test show how each browser has been modified for there respectable os..if one is faster than the other than its probably better optimized..i would guess if you were to put safari on android or stock ics browser on the iphone they will perform differently as they were not optimised.

posted on 22 Aug 2012, 01:41 1

53. i_am_aman (Posts: 13; Member since: 09 Aug 2012)


what about the wifi in S3 & IP4 that too can make the diff...? :P

posted on 22 Aug 2012, 15:31 1

59. taz89 (Posts: 2014; Member since: 03 May 2011)


lol accidently thumbed you down...you are very right about wifi...if the wifi component is cheap on ome device and a more expensive wifi compoment on another it could very well make a difderence although probably in the miliseconds

posted on 21 Aug 2012, 11:24 2

24. joaolx (Posts: 364; Member since: 16 Aug 2011)


It still has a faster cpu and more ram.

posted on 21 Aug 2012, 12:45 1

33. sadaivadai (Posts: 156; Member since: 22 Nov 2011)


The test conducted in this way is better .. Since we are not going to close all the apps when using the browser ..

posted on 21 Aug 2012, 09:58 16

2. abdane (Posts: 494; Member since: 07 Oct 2011)


wow, shocked to see stock browser better than chrome ! o.O

posted on 21 Aug 2012, 12:02 3

30. jaoowolabi (Posts: 201; Member since: 07 Jun 2012)


yeaa but im still goin to use chrome. CHROME FTW

posted on 21 Aug 2012, 13:14 3

36. thelegend6657 (unregistered)


not surprised at all
try both on a galaxy nexus and you will feel it

posted on 21 Aug 2012, 19:50 2

48. The_Godfather (Posts: 187; Member since: 26 Apr 2012)


Google Chrome ------ The Beast

posted on 26 Aug 2012, 07:07

65. IamYourFather6657 (Posts: 321; Member since: 01 Jul 2012)


is there a way to port ICS browser to jellybean ? Chrome sucks

posted on 21 Aug 2012, 10:04 5

4. -box- (Posts: 3991; Member since: 04 Jan 2012)


Wow, Opera needs to get itself updated or something. I remember when it was the go-to browser if speed was key, especially with its compression and "turbo" functions

posted on 21 Aug 2012, 10:19 1

11. remixfa (Posts: 14255; Member since: 19 Dec 2008)


opera mobile is not the same as opera mini. Opera mini is the speed browser I do believe. It still is the champion. However it uses side loading tricks and data compression to achieve that speed, which would give it unfair advantage in a regular browser test.

posted on 21 Aug 2012, 10:28

12. bobfreking55 (Posts: 866; Member since: 15 Jul 2011)


what's the difference of mini and mobile?

i've been using opera because opera usually doesn't load all flash content and such and I like the interface.

the close button on the ics stock browser and chrome is very prone to accidental touches. it's the worst part for me since I frequently switch between tabs.

posted on 21 Aug 2012, 11:23 2

23. denied911 (banned) (Posts: 361; Member since: 31 May 2012)


on mini pages are rendered on opera serwers and compresed
on mobile phone renders page and you can choose to compress data or not
mini for slower phones and bandwith save
mobile for fast phones
I have browsermar on sgs3 international 75.000
and moto razr has 55.000
i don't know where they find this results
probably apple payed them

posted on 21 Aug 2012, 11:31 2

28. POLICE (banned) (Posts: 61; Member since: 21 Aug 2012)


Did you just type from your phone?

posted on 21 Aug 2012, 15:14 1

43. denied911 (banned) (Posts: 361; Member since: 31 May 2012)


yep :)

posted on 21 Aug 2012, 17:05 2

46. remixfa (Posts: 14255; Member since: 19 Dec 2008)


one is the regular mobile browser with full features, and the other is a more limited browser meant for quick page loads and very limited data use. Its been in use since RIM was popular. Basically when you put in a web address it pulls up over at Opera's servers who more or less take a medium resolution snap shot and send it to your phone. The result is that it loads up lightning quick and uses like 1/5th the data. The downsides are the lack of page options like flash, HTML5, ect.

posted on 26 Aug 2012, 12:20

66. rusticguy (Posts: 2828; Member since: 11 Aug 2012)


Opera mini doesnt work well for responsive sites and many sites are going in for responsive design.

posted on 21 Aug 2012, 10:07 8

5. OpTiMuS_BlAcK (Posts: 418; Member since: 04 May 2012)


At least Dolphin is still the best in HTML5 :)

posted on 21 Aug 2012, 21:44

52. torr310 (Posts: 890; Member since: 27 Oct 2011)


I tried both ICS stock and Chrome, Dolphin has way better UI.
It's a snap to switch between your favorite webs on Dolphin.

posted on 21 Aug 2012, 10:11

7. rusticguy (Posts: 2828; Member since: 11 Aug 2012)


Check performance on responsive design based sites also with adaptive images ... perhaps test on bostonglobe.com

posted on 21 Aug 2012, 10:14

8. hung2900 (Posts: 956; Member since: 02 Mar 2012)


One thing that the article forgot is page loading time also depends a little bit on resolution.

posted on 21 Aug 2012, 10:14 2

9. androidornothing (Posts: 143; Member since: 26 Apr 2012)


Chrome with Jelly Bean will kill any browser out there.

posted on 21 Aug 2012, 11:16 3

21. aaronkatrini (Posts: 241; Member since: 06 Jun 2012)


wow! android is all about linux and people support google instead of firefox.... mah! Sad Tux is Sad :(

posted on 21 Aug 2012, 10:18 1

10. remixfa (Posts: 14255; Member since: 19 Dec 2008)


For these comparisons, you should also do "chrome on iOS" since that is available just to get a feel for how the different OS's use the same/similar code, also any other browsers that might be available on both iOS and Android for the same point.

What I find interesting is how few "features" Safari has compared to Android's stock/chrome browsers and still doesnt manage to best them. 26 features for iOS and 56 for android stock. Yea... looks like iOS has another place where it needs an update to a really old system.

posted on 31 Aug 2012, 17:24

71. Hemlocke (unregistered)


You need to get out more, or take a college class, because reading is obviously not your strong suit. You read what you WANT it to be, instead of what it really is, so the second paragraph just makes you look like a pathetic fanboy. I'm reading, and so is everyone else, 56 for both. Having owned plenty of Android and iOS devices, the only real difference comes down to personal preference where browsers are concerned.

posted on 21 Aug 2012, 10:35 2

13. vivzek (Posts: 37; Member since: 03 Jul 2012)


I use the Dolphin browser a lot these days and it seems to be doing the work pretty fine and reliably.

posted on 21 Aug 2012, 10:37 1

14. macfire111 (Posts: 2; Member since: 21 Aug 2012)


why has internet explorer been tested ? Or is it not considered good enough for these "tests"

Want to comment? Please login or register.

Latest stories