Windows iOS Apple Android Microsoft Google

Testing shows Siri beating out Google Now and Cortana for accuracy, user satisfaction and more

posted by Alan F. / Nov 09, 2015, 5:39 PM

Testing shows Siri beating out Google Now and Cortana for accuracy, user satisfaction and more

Which of the three top mobile platforms has the best virtual voice activated personal assistant? A company called Experts-Exchange had iOS, Android and Windows Phone users in the U.S. each ask four questions to Siri, Google Now and Cortana, respectively, and have them complete three tasks. The participants were told to score each response for accuracy, and keep track of the number of times they were given follow-up questions. Other metrics were also scored by the phone users.

The four questions that testers asked their assistant were: Who won the Super Bowl in 1978?, How many calories in a muffin?, Where can I buy tires? and When is "Kung Fu Panda 3" coming out? The three tasks were: Ask your phone to set an appointment, Turn the Wi-Fi setting on, and Send a text message.

Siri received high marks from users for answering the questions. For example, when the three assistants were asked the question about who won the Super Bowl in 1978, Siri answered correctly 95.3% of the time. 86.1% of users were satisfied with the response. While Google Now had the correct answer 88% of the time, 80% of the time it responded with a web search. Cortana gave the wrong answer 3.3% of the time.

When users asked their personal assistant to set up an appointment, Siri did it correctly during 92.3% of the attempts. 89.2% of users were satisfied with the response. Those two figures for Google Now were 81.3% and 80%. Cortana set the appointment up correctly 73.3% of the time, with 70% of the Windows Phone users satisfied with her response.

Overall, Siri had the fewest incorrect answers (2.4%), the highest number of satisfied users (81%), the lowest number of follow-up questions (5.2%) and was tied with Google Now for having the lowest percentage of answers that were in the form of a web search (5%). Google Now was second in the test, with Cortana third. Google Now (68%) and Cortana (57%) had low satisfaction scores compared to Siri, which has to be concerning for Google and Microsoft.

Interestingly, those living in the Western states gave higher satisfaction scores to Siri, while those living in the East gave higher satisfaction scores to Google Now and Cortana. Additionally, women using Cortana and Google Now received follow-up questions twice as often as men. This might have to do with the way that women using the two personal assistants structured their questions and task requests. Siri, on the other hand, asked follow-up questions of men more often than women.

Siri outperforms Google Now and Cortana in a test of personal assistants

View more + 1 image

source: ExpertsExchange via WMPoweruser

FEATURED VIDEO

Options

79 Comments

1. darkkjedii

Posts: 31764; Member since: Feb 05, 2011

I hate that Google now won't read my emails, but it'll read my texts. Siri does both. Siri does have its weak points too, overall they're about even. I've zero experience with Cortana.

posted on Nov 09, 2015, 5:41 PM 4

2. Commentator

Posts: 3723; Member since: Aug 16, 2011

Voice assist is all well and dandy, but 99% of my search activity is through typing, and for me Google is the only way to go.

posted on Nov 09, 2015, 5:46 PM 10

11. AlikMalix unregistered

Unlike Google now, you can tell Siri to search using any engine including Google!!! Typing takes too long and requires your eyes and attention - asking vice assistant is fast, requires no attention and can be dictated a long enquiry if you keep holding the home button as you ask. I can stop talking for 20 seconds or a minute (I haven't tested for longer than that) and Siri will wait until you're done dictating your enquiry. Vey important - and you don't have to think what you're about to ask before evoking the voice assistant.

posted on Nov 09, 2015, 9:06 PM 3

15. Awalker

Posts: 1986; Member since: Aug 15, 2013

Are you an Apple employee by any chance? It seems like every post I read of yours you shill for Apple.

posted on Nov 09, 2015, 9:23 PM 6

20. AlikMalix unregistered

I loved to write in school. I enjoy leading up to a punchline and grand fenalies. I know how my posts seem. I just can't write the typical "android sucks, Apple is king" posts. I enjoy elaborating and crating a debate - unfortunately the responses are juvenile and uninspiring; I do hope to grab attention of a few that oppose my views but print a little class to conversations. I could care less how Apple does financially - I actually voiced that it would be interesting to see Apple failing or under stress to see why they would do when profits slow down - unfortunately that means I have to stop buying Apple devices and I don't want to go to android (personal choice).

posted on Nov 09, 2015, 10:04 PM 3

25. AlikMalix unregistered

Edit: ... couldn't care less... (too late to edit).

posted on Nov 09, 2015, 11:47 PM 1

37. magnanimus

Posts: 565; Member since: Mar 29, 2013

Actually you seem like an interesting person to have an argument with

posted on Nov 10, 2015, 7:44 AM 2

40. Awalker

Posts: 1986; Member since: Aug 15, 2013

He's too dogmatic to have an interesting conversation. He seems more annoying than anything else.

posted on Nov 10, 2015, 8:19 AM 2

39. flipjzn

Posts: 257; Member since: Jun 22, 2012

It's an apple related article so i don't see anything wrong actually.

posted on Nov 10, 2015, 8:07 AM 1

54. TechieXP1969

Posts: 14967; Member since: Sep 25, 2013

Because he's a shill for Apple 0__o /S

posted on Nov 10, 2015, 10:52 AM 0

3. nctx77

Posts: 2540; Member since: Sep 03, 2013

Siri has gotten better and faster with each iPhone release. The experience will vary depending on which iPhone you have. Right now, Google now just seems quicker to respond, but Siri has more personality. I can't wait to see how these things progress over the next 5 years!

posted on Nov 09, 2015, 5:49 PM 3

34. tech2

Posts: 3487; Member since: Oct 26, 2012

one more thing to bear in mind is for accuracy of voice assistants a lot depends on hardware as well i.e. the device you are using and since Siri is only on iPhones and iPad which have better hardware capability then an average $200 android. I'd say the difference is negligible.

posted on Nov 10, 2015, 6:44 AM 0

41. marorun

Posts: 5029; Member since: Mar 30, 2015

By Example Motorola phone would get better result than any iphone ever using voice assistant and voice command. the only problem here is the company thats did the test was paid by Apple to do it so they most probably chosen windows and android phone thats where inferior at the base. We just tested the moto X play vs iphone 6S in store today and i am sorry but beside in english where Siri did almost as good as moto voice when we switched in french Siri was crap. Also Google now ( on wich moto voice is based ) seem much better at translating and understanding various languages.

posted on Nov 10, 2015, 8:22 AM 1

55. TechieXP1969

Posts: 14967; Member since: Sep 25, 2013

Who needs personality. All Iw ant is answers that are accurate. Since I don't use Siri I can't comment. But when I use Google now, it has never been wrong. Directions is the main thing I used it for over summer while on vacation. I got very timely updates on traffic, crashes, sports teams back at home and more without even asking. Samsung's S-Voice is never mentioned. On my Gear S its awesome because the device houses the database for S-voice so I get quick results. On the phone its slower, but also very accurate. But Google Now is much faster!

posted on Nov 10, 2015, 10:56 AM 0

70. flipjzn

Posts: 257; Member since: Jun 22, 2012

And you're a pathetic troll who doesnt have a job but rather be on all apple related article with your offensive shield on. :)

posted on Nov 10, 2015, 1:37 PM 1

73. keekai05

Posts: 116; Member since: Mar 31, 2015

Woot! Love it!

posted on Nov 11, 2015, 2:08 PM 0

4. wando77

Posts: 1169; Member since: Aug 23, 2012

I just asked the questions 10 x each on my galaxy s6 edge plus and it got every one righthing. 30 questions out of 30 questions answered correctly..... mental

posted on Nov 09, 2015, 5:54 PM 3

5. wando77

Posts: 1169; Member since: Aug 23, 2012

Just done the WiFi, calender and text message 5 x each and 100% there. I must have a lovely clear voice ;)

posted on Nov 09, 2015, 6:00 PM 2

22. Tizo101

Posts: 644; Member since: Jun 05, 2015

all these things quickly become crap when you're not a native English speaker (that's a lot of people)

posted on Nov 09, 2015, 11:18 PM 0

27. nodes

Posts: 1164; Member since: Mar 06, 2014

^this. lol, can't agree more.

posted on Nov 10, 2015, 1:36 AM 0

31. AlikMalix unregistered

Actually Siri works extremely well in all the languages it supports and there's a lot. I can attest to certain European language that Siri does excellent in dictation, commands, searches, and every aspect of English Siri - the Eastern European Siri can do - my non English speaking family members are using it specially my grandpa - who find it easier to ask Siri to do something on the phone than to do it manually - believe it or not... Can someone tell me if they implemented Google now to understand what language is spoken (up to 5 pre selected) without the need to change it manually in settings - if that already works - that's freaked awesome and credit to Google for that. I just read that somewhere on the news a while back, curious if it's realized yet.

posted on Nov 10, 2015, 4:49 AM 1

44. marorun

Posts: 5029; Member since: Mar 30, 2015

Google now can understand any number of language all at the same time its also can translate them on the fly.

posted on Nov 10, 2015, 8:24 AM 0

42. marorun

Posts: 5029; Member since: Mar 30, 2015

Nope Google one can handle almost any language as good. Siri get crappy with others than english thats right.

posted on Nov 10, 2015, 8:23 AM 0

59. AlikMalix unregistered

And you are fluent on all languages that Siri speaks, to make that comment?

posted on Nov 10, 2015, 12:25 PM 0

74. keekai05

Posts: 116; Member since: Mar 31, 2015

No. He's just the biggest troll as he is that actually owns a shop where people have their brand new iPhone repaired instead of going into an Apple shop which also an owner of Sonim XP7.

posted on Nov 11, 2015, 2:12 PM 0

6. Commentator

Posts: 3723; Member since: Aug 16, 2011

What about S Voice data?

posted on Nov 09, 2015, 6:04 PM 1

35. tech2

Posts: 3487; Member since: Oct 26, 2012

Its 100% accurate. Since Jong Shin is the only one using it

posted on Nov 10, 2015, 6:47 AM 3

7. EC112987

Posts: 1216; Member since: Nov 10, 2014

I use Siri the most and it's pretty accurate when I'm in a quiet room. Google isn't bad either but I rather do things manually in my devices/

posted on Nov 09, 2015, 6:12 PM 0

8. Taters

Posts: 6474; Member since: Jan 28, 2013

Last time I checked Googlenow smoked Siri. Google can get paragraphs with no errors and Siri not so much. Of course that was a long time ago and I don't use either all that much. Either way, chalk up Siri as useless like 3D Touch is. So Touch ID is the only one actually useful and Moto did it first.

posted on Nov 09, 2015, 6:46 PM 1

12. AlikMalix unregistered

Moto did it wrong. First it's in a different location (not imbedded into a button you use often). It actually kept your fingerprint itself that can be extracted which is something that is a no-no in security of things. And failure rate was horrible compared to even the first touch if on iPhone 5S.

posted on Nov 09, 2015, 9:09 PM 3

view all comments

Latest Stories

View more news