x PhoneArena is hiring! Reviewer in the USA

Siri tops Cortana and Google Now in multi-language test

Posted: , by Alan F.

Tags:

Siri beats out Google Now and Cortana in multi-language test

Siri beats out Google Now and Cortana in multi-language test


A test of the three major voice-activated virtual personal assistants found that when it comes to multi-language use, Siri is more accurate than its rivals. 18 questions in English, Italian, French, German and Mandarin were asked to each of the three personal assistants. Answers that quickly came back correct received a 1.0 score. Those with correct answers that were not quite as easy to find (for example, they might be hidden among search results) were scored a 0.5. Answers that were irrelevant to the question, or which stated that the task could not be completed, were scored a 0.0.

When it came to English, all three scored well and within a few points of each other. Siri (14.5/18) topped Cortana (12.5/18) and Google Now (11.5/18). Siri managed to duplicate her success in Italian with a score of 14.5 while Google Now and Cortana trailed badly with scores of 8.5 and 6, respectively. While most of the other languages saw similar results, Mandarin saw Siri tally an impressive 13.5 while Cortana scored a 5 and Google Now performed miserably with a 1.5 score.

Interestingly, Cortana was the personal assistant who was more likely to respond to an inquiry with a web search. In terms of accuracy across all the languages, Siri scored the highest at 76% topping the 46% scored by Google Now and the 42% achieved by Cortana. Check out the infographic produced about the test, which we cut into easy to read morsels in the slideshow below.


source: VentureBeat via WMPoweruser

72 Comments
  • Options
    Close




posted on 07 Feb 2015, 23:47 2

1. emanuelwooten (unregistered)


no surprise here apple pretty much started the virtual assistant in phones so they should have the best one. I wish Google would put more work into developing there's.

posted on 07 Feb 2015, 23:52 14

3. 14545 (Posts: 1468; Member since: 22 Nov 2011)


What are you talking about? Google did voice search years before apple. Again with everyone thinking nothing existed before apple invented it. The only thing about Google's implementation pre-siri is it was less user friendly and wouldn't talk back.

posted on 07 Feb 2015, 23:54 2

5. AlikMalix (Posts: 5238; Member since: 16 Jul 2014)


Siri existed before Google had a voice search app (it was a standalone app in App Store)... Google Search is still stand alone app that was also and still is available in App Store...

This article is about Google Now which debuted almost a year after Apple integrated their OS with Siri...

posted on 08 Feb 2015, 00:15 14

7. 14545 (Posts: 1468; Member since: 22 Nov 2011)


Slow down sparky. Siri was bought by Apple. Also, Google has had voice search baked in since 2.3 (iirc) feel free to do a little research next time.
http://en.m.wikipedia.org/wiki/Google_Voice_Search

Google now is/was not Google voice search. Not that I expect an apple fan to bother actually looking something up though.

posted on 08 Feb 2015, 02:30 2

20. illusionmist (Posts: 157; Member since: 29 Jan 2013)


If we're talking about things that are not exactly the same, iOS had Voice Control back in iOS 3.0, which, IIRC, was even earlier than Android 2.0.

posted on 08 Feb 2015, 11:43

49. sprockkets (Posts: 1611; Member since: 16 Jan 2012)


And if we really want to say who was first, WinMob did it years before everyone, I having used it in 2005, could control a lot of stuff like music playback and such. And then some other phones did it on a basic level even earlier.

Moto Ming had it also in 2006.

posted on 08 Feb 2015, 00:41 2

12. tedkord (Posts: 10675; Member since: 17 Jun 2009)


And it was a more powerful and functional search app when it was an app.

posted on 09 Feb 2015, 01:59

62. AlikMalix (Posts: 5238; Member since: 16 Jul 2014)


No it wasn't - it was basic, not integrated with the entire system, and eventually would be no where close of functuality (like finding your kids, or making reservations, or setting location, time or timed reminders, or various app integration) that Apple made it into today... In comparison, Google tries to predict based on information that Google collected - and to be honest it's not very good at it... My schedules and locations are always different at least Siri is ready for ALL tasks from a locked blank screen.... on Android Google Now is mostly a few clicks/swipes away if you use a locked phone... Siri can be modified to be available without unlocking the phone... She learns which of 3 Mikes in your contact list you often talk to, and her replies are quite humanlike (which you can turn off if you dont want an audio responce from it)... Google Now just keeps guessing... and guessing... and you keep swiping those cards away, instead of getting it to run your iDevices like Siri does...

posted on 08 Feb 2015, 09:51 1

43. InspectorGadget80 (unregistered)


FYI SIRI was purchase from Apple include their finger reader, Apple never invented anything they just buy companies and slapped their logo on it. Not one voice search assistant isn't accurate to hear your voice. So why go gaga over a stupid voice assistant and starting more flame wars on this useless blog site?

posted on 08 Feb 2015, 17:42 2

61. Mxyzptlk (Posts: 12051; Member since: 21 Apr 2012)


Google bought Android and Youtube. Your point?

posted on 09 Feb 2015, 02:05

63. AlikMalix (Posts: 5238; Member since: 16 Jul 2014)


Not starting flamewars, but Siri is incredibly useful if you let it have the power - and she does that without collecting your information unless you provide it (like this is where I live, or this is where I work, or this person is my wife, etc..) Google Now is great at doing searches - it's basically a glorified searchbot with extra functions. At least with Siri I can ask which search engine to use (not stuck with just Google and what Google thinks their real clients - the ones paying to display you ads - want you to see....)

posted on 08 Feb 2015, 03:27 2

25. emanuelwooten (unregistered)


apple was to first to do it right. i know siri is the best and i dont even own an iphone lol.

posted on 08 Feb 2015, 07:54 2

36. Liveitup (Posts: 1798; Member since: 07 Jan 2014)


Both of you are wrong. Bing " Tell Me" was the first VA on smartphones.

In any case all of these VA will come out on top in different areas. Now ill like for some company to fo a complete list of things that VA should do and see who truly comes out on top. For me overall Cortana is best.

posted on 08 Feb 2015, 08:17 5

37. Napalm_3nema (Posts: 2157; Member since: 14 Jun 2013)


WP didn't launch until late 2010, so you should check your timelines. There wasn't even a "Bing" until June of 2009, the same month iOS 3.0 was released, which had voice capabilities. WP is always last to the party, if it's invited at all.

posted on 08 Feb 2015, 09:53 1

44. Liveitup (Posts: 1798; Member since: 07 Jan 2014)


Do us a favor what were the capabilities of iOS 3.0, could it text someone or call someone, explain to us exactly what it did. Too often people like yourself would claim something did this and that but they never explain in detail.

You don't need to tell me when different OS and services were released im quite aware of it.

Further more if you want to get technical about features like Microsoft Voice Command were already found on Windows mobile devices as far back as 2003.

When you say Windows Phone is always late to the party that comment is simply inaccurate, many of the features found in smartphones now were found in WP before any other OS, for eg. I recall a time when what is arguably the biggest trend in tech today (Flat UI) was only done by Windows Phone.

You should check your timelines and so called facts cause in many cases WP started the party.

posted on 08 Feb 2015, 11:03 3

47. Napalm_3nema (Posts: 2157; Member since: 14 Jun 2013)


You could do anything "Tell Me" could in iOS 3. I know, I owned a couple of WP7 devices, as well as a 3GS.

"Flat UI" isn't a feature. It doesn't provide any benefit since it is just an aesthetic.

Troll harder. WP is behind, and in 4+ years, it has all the traction of Teflon tires on ice.

posted on 08 Feb 2015, 12:19 1

53. Liveitup (Posts: 1798; Member since: 07 Jan 2014)


Okay again you are doing it could you please provide evidence to support your claim that iOS 3 could do anything WP7 could do, you saying that you owned both platforms doesn't do it for me. Evidence is what matters.

Tell me on Windows Phone 7.

https://www.youtube.com/watch?v=JxlUatGmnDA

Show me some evidence of iOS 3 doing the same as Tell Me. Not saying you are lying im just saying prove it.

Voice command was around even earlier.

Only someone short-sighted could say that Flat UI doesn't provide any benefit, if that was the case why is everyone adopting it, ask yourself, aesthetic itself a benefit, it focuses on beauty.

Read up about some of the advantages of Flat UI.

http://graphicdesignjunction.com/2013/05/flat-designing-and-its-advantages/

You clearly lack the understanding of what a troll is. Only thing that 4 years behind is your insight.

posted on 08 Feb 2015, 11:04

48. 14545 (Posts: 1468; Member since: 22 Nov 2011)


Both of who are wrong? I never said anything about being first, just that Apple didn't do anything first. Windows Mobile and Symbian were more advanced than iOS, even up until iOS7. I'm just sick of the Apple cult thinking their brand created everything.

posted on 08 Feb 2015, 12:14

52. Napalm_3nema (Posts: 2157; Member since: 14 Jun 2013)


Right, which is why Microsoft decided to redesign their OS after the iPhone dropped and why Nokia abandoned all of their platforms for WP. Whatever helps you sleep at night.

posted on 08 Feb 2015, 15:59 1

60. 14545 (Posts: 1468; Member since: 22 Nov 2011)


Did you use either of those operating systems? Serious question? If you didn't, then you don't have a clue. Which most of the apple cult doesn't. Actually, Windows regressed in the conversion from WinMo to WP. But people bought apple because they were already locked into the apple ecosystem and thought it was the "best" because.....welll.........apple.

posted on 08 Feb 2015, 12:24 1

54. Liveitup (Posts: 1798; Member since: 07 Jan 2014)


You are correct you didn't mention anything about being first. I apologize..

posted on 09 Feb 2015, 02:14

64. AlikMalix (Posts: 5238; Member since: 16 Jul 2014)


I like your idea...

1. Control/toggle settings
2. Find people
3. Remember who your parents, kids, siblings, co-workers, and frequent people you socialize with
4. Set up meetings, and reservations
5. Search for info from more than just Google
6. Initialize apps, texts, calls, emails as well as read them to you, modify them and reply
7. Store information that you want it to remember
8. Know when to give you audio feedback and when not to: while in car vs. while in the store.
9. Take Notes
10. Find Apps and install them
11. Find/recognize music and install/buy them
12. Search for particular photo/text/contact/document/etc..
13. Find and provide info from other devices on your cloud
14. Support dictation and commands in other languages
15. Find locations, and provide directions, ETA,
16. Find business info and make a call on your behalf or route directions.
17. Be used to control your car, house, and appliances
18. And ofcourse other basic things like weather, sports, traffic

posted on 08 Feb 2015, 08:47

40. -box- (Posts: 3991; Member since: 04 Jan 2012)


Plus Symbian and others had voice commands before even android did. I remember using my Nokia with Symbian and telling to to call a certain contact and it would. It was rudimentary, but there. IIRC it was before android and iphonies were even being sold.

posted on 09 Feb 2015, 02:36

65. AlikMalix (Posts: 5238; Member since: 16 Jul 2014)


When poeple refer to these WebOS and Symbians -- what phones are they on now? do they also have a touchscreen, ecosystems with apps and integration with homes/cars/health, etc...? Accessories such as pens, construction equipment, and other things... ? I understand BB and WP? but I dont see the relevance of WebOS and Symbian - it's like saying Hey there are these other cars besides Toyota's,BMW's and etc... they have wheels and doors, but you gotta pedal and they dont have ability to drive on modern roads... I have never heard of these WebOS and Symbians until someone started to disprove iDevices that they were not first at something and for obvious resons - Android has been second to every tech that builds the backbone of our modern personal devices....

posted on 08 Feb 2015, 00:19 6

8. LetsBeHonest (Posts: 1385; Member since: 04 Jun 2013)


http://www.phonearena.com/news/Google-Now-vs-Siri-vs-Cortana-showdown_id59877
I'm confused which one is the best.

posted on 08 Feb 2015, 00:43 3

13. tedkord (Posts: 10675; Member since: 17 Jun 2009)


It depends. Overall, GN>Cortana>Siri. But each has it's strengths and weaknesses. And I think Cortana is improving the most the quickest.

posted on 08 Feb 2015, 00:55 3

15. ihavenoname (Posts: 1693; Member since: 18 Aug 2013)


GN and Cortana are definitely more useful, though neither of them match the personality of Siri. GN wins Cortana for me by having Google as a search engine. So GN>Cortana>Siri.

posted on 08 Feb 2015, 09:45

42. fcjan (Posts: 8; Member since: 21 Oct 2014)


you are all wrong, I had voice comand on my Ericsson T29s from 2001.

posted on 08 Feb 2015, 12:54

57. lyndon420 (Posts: 3991; Member since: 11 Jul 2012)


Google has...you should try it.

posted on 07 Feb 2015, 23:51 3

2. Settings (Posts: 1501; Member since: 02 Jul 2014)


If it's in Filipino, Siri, Google NOW and Cortana would all fail.

posted on 08 Feb 2015, 03:29

26. Neros (Posts: 1016; Member since: 19 Dec 2014)


Filipino? They still don't support quite a few European languages, let alone anything as exotic as Filipion. I'm still waiting for the official support of my language.

posted on 07 Feb 2015, 23:52 5

4. AlikMalix (Posts: 5238; Member since: 16 Jul 2014)


I see people use Siri all over the place, NEVER seen anyone one with Android using their Voice Assistants or Google Now... Most people with Android dont know about Google Now (they ask how they can get Siri on their Android phone)... True story...

posted on 08 Feb 2015, 00:27 5

10. LetsBeHonest (Posts: 1385; Member since: 04 Jun 2013)


Well I've never seen any one using any of these in public. I don't use it either. I use WP. I did tried Cortana for fun when they released it. After all I find Google's approach way better than other two(personal opinion).

posted on 08 Feb 2015, 00:30 6

11. Commentator (Posts: 3669; Member since: 16 Aug 2011)


Because, unlike Siri, Google Now actually gives you the option to TYPE your question without having to yell at your phone first. True story.

I'd take Google Now any day over Siri on that alone. Siri can get back to me when I want to hear some corny joke some Apple programmer coded in over his lunch hour because Steve Jobs demanded it be more "personal."

posted on 09 Feb 2015, 02:44

66. AlikMalix (Posts: 5238; Member since: 16 Jul 2014)


What's the point of TYPING in a question if we're talking about VOICE ASSISTANTS!!!! If I didnt want to use my voice to create a calendar event - I can ALSO type it in, dumb ass....

My main uses for Siri is to set location and time based reminders/events, change/toggle phone settings, locate my family members, and basic call, text, take notes, give directions, or search the web... for which (unlike Google Now) I dont need to unlock my phone using a pin/pattern to get accomplished... or am I wrong?

posted on 10 Feb 2015, 09:02

72. elitewolverine (Posts: 5117; Member since: 28 Oct 2013)


Honestly? Ease of use for older people.

I have had many 60+ who forget where certain things are. I show them on a windows phone, to press the search icon, type call or say call, and bam that is all they need. Or message...or or or...

I have used it with so much success in support its rather hilarous at how usefull this feature is.

posted on 08 Feb 2015, 00:45 4

14. tedkord (Posts: 10675; Member since: 17 Jun 2009)


That's because we don't need to talk to Google Now for it to be useful - it learns and provides us with info automatically. (And I don't know where you live, but here in the US I don't see anyone using any of them out in the open)

posted on 08 Feb 2015, 01:38 2

18. mrochester (Posts: 528; Member since: 17 Aug 2014)


It only does that if you've already locked yourself into the Google ecosystem. Google Now is essentially useless when you don't use any Google services (as I don't).

posted on 08 Feb 2015, 02:47

22. tedkord (Posts: 10675; Member since: 17 Jun 2009)


Well, of course. It is a Google service. I do use them because they're insanely useful and pretty much best in the market.

posted on 08 Feb 2015, 03:23

24. lyndon420 (Posts: 3991; Member since: 11 Jul 2012)


Siri is useless without apple and Cortana is useless without ms. Your point???

posted on 08 Feb 2015, 08:20 2

38. Napalm_3nema (Posts: 2157; Member since: 14 Jun 2013)


His point was that Siri is useful without your every action being data mined. Google Now and Cortana are much less useful unless you are paying for your phone a second time with every bit of data you provide.

posted on 08 Feb 2015, 06:46

34. leftheodo (Posts: 88; Member since: 21 Oct 2011)


So you don't use Google search, Google maps, Youtube, Gmail, Translation etc? Do you even have a smartphone?

posted on 09 Feb 2015, 06:57 1

68. elitewolverine (Posts: 5117; Member since: 28 Oct 2013)


Nope, google maps went out the window for me when it couldnt find 3 local places and here maps could. I use youtube far longer than before google bought it - kind of have to. Gmail i use only for techsupport and not for actual job use, but to show how to reset passwords (yes people are this tarded), translation? nope bing. You can have a smartphone and gasp....not be locked into their services. my msn account has proven to be just as good as gmail ever has been.

posted on 08 Feb 2015, 13:09

58. lyndon420 (Posts: 3991; Member since: 11 Jul 2012)


Actually that's not quite true either as GN is constantly updated to incorporate other apps and services not just Googles.

posted on 08 Feb 2015, 03:29

27. lyndon420 (Posts: 3991; Member since: 11 Jul 2012)


The main reason why you won't see us talking to our phones is because our questions are usually answered before we have a chance to ask it anything.

posted on 08 Feb 2015, 04:48

31. RebelwithoutaClue (Posts: 2753; Member since: 05 Apr 2013)


I know Google Now and never use it. The only reaon I'm talking to my phone is when another person is on the other end of a phonecall :)
And of the 120 people using an iPhone at work, only 2 know what Siri is (but never use it). On the 140 iPads I administer, Siri is even disabled.

posted on 08 Feb 2015, 11:00 1

46. 14545 (Posts: 1468; Member since: 22 Nov 2011)


The only real place I have even found a "voice assistant" useful, is in the car. Like asking for directions or traffic so I don't actually have to stare at my phone. Otherwise, anyone that uses it in public is a tool.

posted on 08 Feb 2015, 08:36

39. androidwindows (Posts: 187; Member since: 04 Oct 2014)


"Most people with Android dont know about Google Now"

The biggest BS I've heard all year long.

posted on 09 Feb 2015, 06:59 1

69. elitewolverine (Posts: 5117; Member since: 28 Oct 2013)


working in tech, this is rather true. I would consider it probably as high as 70% with the people i deal with. However that percent is watered down by the fact the people that need help didnt even know you could use your phone and talk at the same time on it.

posted on 08 Feb 2015, 08:50

41. -box- (Posts: 3991; Member since: 04 Jan 2012)


Maybe you see them using it so much because it doesn't work as well, while the Winners using Cortana and robots using android have already gotten the info they need and put the phones back in their pockets and purses.

posted on 08 Feb 2015, 00:11 4

6. LionStone (Posts: 730; Member since: 10 Dec 2010)


I call bull. My friend uses English siri all the time and I can't say how many times I have to pull out a decipher manual! Recently it caused such a miscommunication that he missed a pickup at the airport and he had to cab it home! Good going siri! I use Google voice action all the time and it's almost always spot on!... True story.

posted on 08 Feb 2015, 00:21 1

9. Kruze (Posts: 1285; Member since: 30 Dec 2014)


Where's S Voice? :P

posted on 08 Feb 2015, 01:27 7

16. Settings (Posts: 1501; Member since: 02 Jul 2014)


Sorry. No bloats allowed. Lol!

posted on 08 Feb 2015, 01:32 1

17. ArtSim98 (Posts: 3535; Member since: 21 Dec 2012)


I literally never use google now XD

posted on 08 Feb 2015, 06:33

33. Tritinum (Posts: 471; Member since: 06 May 2014)


I use it all the time, just not the voice search reason being English isn't my first language and typing is more subtle.

posted on 08 Feb 2015, 02:22

19. HugoBarraCyanogenmod (Posts: 1046; Member since: 06 Jul 2014)


No lies only siri understand our language, I'm forced to speak English when it comes to Google now, makes me feel like living in the cage

posted on 08 Feb 2015, 03:30

28. lyndon420 (Posts: 3991; Member since: 11 Jul 2012)


What is your language, and why is it so obscure?

posted on 08 Feb 2015, 04:42

30. ArtSim98 (Posts: 3535; Member since: 21 Dec 2012)


He's Chinese.

posted on 08 Feb 2015, 02:42

21. Chamarahcd (Posts: 10; Member since: 01 Feb 2015)


I think discover of virtual assistant is the best every time.

posted on 08 Feb 2015, 03:14

23. LuckyS (Posts: 154; Member since: 07 Dec 2013)


What about simultaneous voice search in two languages? Do Siri and Cortana have that? No, there isn't even an option for my native language in Siri and Cortana.

Want to comment? Please login or register.

Latest stories