Siri tops Cortana and Google Now in multi-language test

Siri beats out Google Now and Cortana in multi-language test

Siri beats out Google Now and Cortana in multi-language test


A test of the three major voice-activated virtual personal assistants found that when it comes to multi-language use, Siri is more accurate than its rivals. 18 questions in English, Italian, French, German and Mandarin were asked to each of the three personal assistants. Answers that quickly came back correct received a 1.0 score. Those with correct answers that were not quite as easy to find (for example, they might be hidden among search results) were scored a 0.5. Answers that were irrelevant to the question, or which stated that the task could not be completed, were scored a 0.0.

When it came to English, all three scored well and within a few points of each other. Siri (14.5/18) topped Cortana (12.5/18) and Google Now (11.5/18). Siri managed to duplicate her success in Italian with a score of 14.5 while Google Now and Cortana trailed badly with scores of 8.5 and 6, respectively. While most of the other languages saw similar results, Mandarin saw Siri tally an impressive 13.5 while Cortana scored a 5 and Google Now performed miserably with a 1.5 score.

Interestingly, Cortana was the personal assistant who was more likely to respond to an inquiry with a web search. In terms of accuracy across all the languages, Siri scored the highest at 76% topping the 46% scored by Google Now and the 42% achieved by Cortana. Check out the infographic produced about the test, which we cut into easy to read morsels in the slideshow below.


source: VentureBeat via WMPoweruser

FEATURED VIDEO

65 Comments

1. emanuelwooten unregistered

no surprise here apple pretty much started the virtual assistant in phones so they should have the best one. I wish Google would put more work into developing there's.

3. 14545

Posts: 1835; Member since: Nov 22, 2011

What are you talking about? Google did voice search years before apple. Again with everyone thinking nothing existed before apple invented it. The only thing about Google's implementation pre-siri is it was less user friendly and wouldn't talk back.

5. AlikMalix unregistered

Siri existed before Google had a voice search app (it was a standalone app in App Store)... Google Search is still stand alone app that was also and still is available in App Store... This article is about Google Now which debuted almost a year after Apple integrated their OS with Siri...

7. 14545

Posts: 1835; Member since: Nov 22, 2011

Slow down sparky. Siri was bought by Apple. Also, Google has had voice search baked in since 2.3 (iirc) feel free to do a little research next time. http://en.m.wikipedia.org/wiki/Google_Voice_Search Google now is/was not Google voice search. Not that I expect an apple fan to bother actually looking something up though.

20. illusionmist

Posts: 157; Member since: Jan 29, 2013

If we're talking about things that are not exactly the same, iOS had Voice Control back in iOS 3.0, which, IIRC, was even earlier than Android 2.0.

49. sprockkets

Posts: 1612; Member since: Jan 16, 2012

And if we really want to say who was first, WinMob did it years before everyone, I having used it in 2005, could control a lot of stuff like music playback and such. And then some other phones did it on a basic level even earlier. Moto Ming had it also in 2006.

12. tedkord

Posts: 17131; Member since: Jun 17, 2009

And it was a more powerful and functional search app when it was an app.

62. AlikMalix unregistered

No it wasn't - it was basic, not integrated with the entire system, and eventually would be no where close of functuality (like finding your kids, or making reservations, or setting location, time or timed reminders, or various app integration) that Apple made it into today... In comparison, Google tries to predict based on information that Google collected - and to be honest it's not very good at it... My schedules and locations are always different at least Siri is ready for ALL tasks from a locked blank screen.... on Android Google Now is mostly a few clicks/swipes away if you use a locked phone... Siri can be modified to be available without unlocking the phone... She learns which of 3 Mikes in your contact list you often talk to, and her replies are quite humanlike (which you can turn off if you dont want an audio responce from it)... Google Now just keeps guessing... and guessing... and you keep swiping those cards away, instead of getting it to run your iDevices like Siri does...

43. InspectorGadget80 unregistered

FYI SIRI was purchase from Apple include their finger reader, Apple never invented anything they just buy companies and slapped their logo on it. Not one voice search assistant isn't accurate to hear your voice. So why go gaga over a stupid voice assistant and starting more flame wars on this useless blog site?

61. Mxyzptlk unregistered

Google bought Android and Youtube. Your point?

63. AlikMalix unregistered

Not starting flamewars, but Siri is incredibly useful if you let it have the power - and she does that without collecting your information unless you provide it (like this is where I live, or this is where I work, or this person is my wife, etc..) Google Now is great at doing searches - it's basically a glorified searchbot with extra functions. At least with Siri I can ask which search engine to use (not stuck with just Google and what Google thinks their real clients - the ones paying to display you ads - want you to see....)

25. emanuelwooten unregistered

apple was to first to do it right. i know siri is the best and i dont even own an iphone lol.

36. Liveitup

Posts: 1798; Member since: Jan 07, 2014

Both of you are wrong. Bing " Tell Me" was the first VA on smartphones. In any case all of these VA will come out on top in different areas. Now ill like for some company to fo a complete list of things that VA should do and see who truly comes out on top. For me overall Cortana is best.

37. Napalm_3nema

Posts: 2236; Member since: Jun 14, 2013

WP didn't launch until late 2010, so you should check your timelines. There wasn't even a "Bing" until June of 2009, the same month iOS 3.0 was released, which had voice capabilities. WP is always last to the party, if it's invited at all.

44. Liveitup

Posts: 1798; Member since: Jan 07, 2014

Do us a favor what were the capabilities of iOS 3.0, could it text someone or call someone, explain to us exactly what it did. Too often people like yourself would claim something did this and that but they never explain in detail. You don't need to tell me when different OS and services were released im quite aware of it. Further more if you want to get technical about features like Microsoft Voice Command were already found on Windows mobile devices as far back as 2003. When you say Windows Phone is always late to the party that comment is simply inaccurate, many of the features found in smartphones now were found in WP before any other OS, for eg. I recall a time when what is arguably the biggest trend in tech today (Flat UI) was only done by Windows Phone. You should check your timelines and so called facts cause in many cases WP started the party.

47. Napalm_3nema

Posts: 2236; Member since: Jun 14, 2013

You could do anything "Tell Me" could in iOS 3. I know, I owned a couple of WP7 devices, as well as a 3GS. "Flat UI" isn't a feature. It doesn't provide any benefit since it is just an aesthetic. Troll harder. WP is behind, and in 4+ years, it has all the traction of Teflon tires on ice.

53. Liveitup

Posts: 1798; Member since: Jan 07, 2014

Okay again you are doing it could you please provide evidence to support your claim that iOS 3 could do anything WP7 could do, you saying that you owned both platforms doesn't do it for me. Evidence is what matters. Tell me on Windows Phone 7. https://www.youtube.com/watch?v=JxlUatGmnDA Show me some evidence of iOS 3 doing the same as Tell Me. Not saying you are lying im just saying prove it. Voice command was around even earlier. Only someone short-sighted could say that Flat UI doesn't provide any benefit, if that was the case why is everyone adopting it, ask yourself, aesthetic itself a benefit, it focuses on beauty. Read up about some of the advantages of Flat UI. http://graphicdesignjunction.com/2013/05/flat-designing-and-its-advantages/ You clearly lack the understanding of what a troll is. Only thing that 4 years behind is your insight.

48. 14545

Posts: 1835; Member since: Nov 22, 2011

Both of who are wrong? I never said anything about being first, just that Apple didn't do anything first. Windows Mobile and Symbian were more advanced than iOS, even up until iOS7. I'm just sick of the Apple cult thinking their brand created everything.

52. Napalm_3nema

Posts: 2236; Member since: Jun 14, 2013

Right, which is why Microsoft decided to redesign their OS after the iPhone dropped and why Nokia abandoned all of their platforms for WP. Whatever helps you sleep at night.

60. 14545

Posts: 1835; Member since: Nov 22, 2011

Did you use either of those operating systems? Serious question? If you didn't, then you don't have a clue. Which most of the apple cult doesn't. Actually, Windows regressed in the conversion from WinMo to WP. But people bought apple because they were already locked into the apple ecosystem and thought it was the "best" because.....welll.........apple.

54. Liveitup

Posts: 1798; Member since: Jan 07, 2014

You are correct you didn't mention anything about being first. I apologize..

64. AlikMalix unregistered

I like your idea... 1. Control/toggle settings 2. Find people 3. Remember who your parents, kids, siblings, co-workers, and frequent people you socialize with 4. Set up meetings, and reservations 5. Search for info from more than just Google 6. Initialize apps, texts, calls, emails as well as read them to you, modify them and reply 7. Store information that you want it to remember 8. Know when to give you audio feedback and when not to: while in car vs. while in the store. 9. Take Notes 10. Find Apps and install them 11. Find/recognize music and install/buy them 12. Search for particular photo/text/contact/document/etc.. 13. Find and provide info from other devices on your cloud 14. Support dictation and commands in other languages 15. Find locations, and provide directions, ETA, 16. Find business info and make a call on your behalf or route directions. 17. Be used to control your car, house, and appliances 18. And ofcourse other basic things like weather, sports, traffic

40. -box-

Posts: 3991; Member since: Jan 04, 2012

Plus Symbian and others had voice commands before even android did. I remember using my Nokia with Symbian and telling to to call a certain contact and it would. It was rudimentary, but there. IIRC it was before android and iphonies were even being sold.

65. AlikMalix unregistered

When poeple refer to these WebOS and Symbians -- what phones are they on now? do they also have a touchscreen, ecosystems with apps and integration with homes/cars/health, etc...? Accessories such as pens, construction equipment, and other things... ? I understand BB and WP? but I dont see the relevance of WebOS and Symbian - it's like saying Hey there are these other cars besides Toyota's,BMW's and etc... they have wheels and doors, but you gotta pedal and they dont have ability to drive on modern roads... I have never heard of these WebOS and Symbians until someone started to disprove iDevices that they were not first at something and for obvious resons - Android has been second to every tech that builds the backbone of our modern personal devices....

8. LetsBeHonest

Posts: 1548; Member since: Jun 04, 2013

13. tedkord

Posts: 17131; Member since: Jun 17, 2009

It depends. Overall, GN>Cortana>Siri. But each has it's strengths and weaknesses. And I think Cortana is improving the most the quickest.

15. ihavenoname

Posts: 1693; Member since: Aug 18, 2013

GN and Cortana are definitely more useful, though neither of them match the personality of Siri. GN wins Cortana for me by having Google as a search engine. So GN>Cortana>Siri.

42. fcjan

Posts: 8; Member since: Oct 21, 2014

you are all wrong, I had voice comand on my Ericsson T29s from 2001.

2. Settings

Posts: 2943; Member since: Jul 02, 2014

If it's in Filipino, Siri, Google NOW and Cortana would all fail.

26. Neros

Posts: 1016; Member since: Dec 19, 2014

Filipino? They still don't support quite a few European languages, let alone anything as exotic as Filipion. I'm still waiting for the official support of my language.

Latest Stories

This copy is for your personal, non-commercial use only. You can order presentation-ready copies for distribution to your colleagues, clients or customers at https://www.parsintl.com/phonearena or use the Reprints & Permissions tool that appears at the bottom of each web page. Visit https://www.parsintl.com/ for samples and additional information.