x PhoneArena is hiring! Reviewer in the USA

Siri tops Cortana and Google Now in multi-language test

Posted: , by Alan F.

Tags :

Siri beats out Google Now and Cortana in multi-language test

Siri beats out Google Now and Cortana in multi-language test


A test of the three major voice-activated virtual personal assistants found that when it comes to multi-language use, Siri is more accurate than its rivals. 18 questions in English, Italian, French, German and Mandarin were asked to each of the three personal assistants. Answers that quickly came back correct received a 1.0 score. Those with correct answers that were not quite as easy to find (for example, they might be hidden among search results) were scored a 0.5. Answers that were irrelevant to the question, or which stated that the task could not be completed, were scored a 0.0.

When it came to English, all three scored well and within a few points of each other. Siri (14.5/18) topped Cortana (12.5/18) and Google Now (11.5/18). Siri managed to duplicate her success in Italian with a score of 14.5 while Google Now and Cortana trailed badly with scores of 8.5 and 6, respectively. While most of the other languages saw similar results, Mandarin saw Siri tally an impressive 13.5 while Cortana scored a 5 and Google Now performed miserably with a 1.5 score.

Interestingly, Cortana was the personal assistant who was more likely to respond to an inquiry with a web search. In terms of accuracy across all the languages, Siri scored the highest at 76% topping the 46% scored by Google Now and the 42% achieved by Cortana. Check out the infographic produced about the test, which we cut into easy to read morsels in the slideshow below.


source: VentureBeat via WMPoweruser

72 Comments
  • Options
    Close






posted on 07 Feb 2015, 23:47 2

1. emanuelwooten (unregistered)


no surprise here apple pretty much started the virtual assistant in phones so they should have the best one. I wish Google would put more work into developing there's.

posted on 07 Feb 2015, 23:52 14

3. 14545 (Posts: 1605; Member since: 22 Nov 2011)


What are you talking about? Google did voice search years before apple. Again with everyone thinking nothing existed before apple invented it. The only thing about Google's implementation pre-siri is it was less user friendly and wouldn't talk back.

posted on 07 Feb 2015, 23:54 2

5. AlikMalix (Posts: 6287; Member since: 16 Jul 2014)


Siri existed before Google had a voice search app (it was a standalone app in App Store)... Google Search is still stand alone app that was also and still is available in App Store...

This article is about Google Now which debuted almost a year after Apple integrated their OS with Siri...

posted on 08 Feb 2015, 00:15 14

7. 14545 (Posts: 1605; Member since: 22 Nov 2011)


Slow down sparky. Siri was bought by Apple. Also, Google has had voice search baked in since 2.3 (iirc) feel free to do a little research next time.
http://en.m.wikipedia.org/wiki/Google_Voice_Search

Google now is/was not Google voice search. Not that I expect an apple fan to bother actually looking something up though.

posted on 08 Feb 2015, 02:30 2

20. illusionmist (Posts: 157; Member since: 29 Jan 2013)


If we're talking about things that are not exactly the same, iOS had Voice Control back in iOS 3.0, which, IIRC, was even earlier than Android 2.0.

posted on 08 Feb 2015, 11:43

49. sprockkets (Posts: 1611; Member since: 16 Jan 2012)


And if we really want to say who was first, WinMob did it years before everyone, I having used it in 2005, could control a lot of stuff like music playback and such. And then some other phones did it on a basic level even earlier.

Moto Ming had it also in 2006.

posted on 08 Feb 2015, 00:41 2

12. tedkord (Posts: 12222; Member since: 17 Jun 2009)


And it was a more powerful and functional search app when it was an app.

posted on 09 Feb 2015, 01:59

62. AlikMalix (Posts: 6287; Member since: 16 Jul 2014)


No it wasn't - it was basic, not integrated with the entire system, and eventually would be no where close of functuality (like finding your kids, or making reservations, or setting location, time or timed reminders, or various app integration) that Apple made it into today... In comparison, Google tries to predict based on information that Google collected - and to be honest it's not very good at it... My schedules and locations are always different at least Siri is ready for ALL tasks from a locked blank screen.... on Android Google Now is mostly a few clicks/swipes away if you use a locked phone... Siri can be modified to be available without unlocking the phone... She learns which of 3 Mikes in your contact list you often talk to, and her replies are quite humanlike (which you can turn off if you dont want an audio responce from it)... Google Now just keeps guessing... and guessing... and you keep swiping those cards away, instead of getting it to run your iDevices like Siri does...

posted on 08 Feb 2015, 09:51 1

43. InspectorGadget80 (unregistered)


FYI SIRI was purchase from Apple include their finger reader, Apple never invented anything they just buy companies and slapped their logo on it. Not one voice search assistant isn't accurate to hear your voice. So why go gaga over a stupid voice assistant and starting more flame wars on this useless blog site?

posted on 08 Feb 2015, 17:42 2

61. Mxyzptlk (Posts: 14180; Member since: 21 Apr 2012)


Google bought Android and Youtube. Your point?

posted on 09 Feb 2015, 02:05

63. AlikMalix (Posts: 6287; Member since: 16 Jul 2014)


Not starting flamewars, but Siri is incredibly useful if you let it have the power - and she does that without collecting your information unless you provide it (like this is where I live, or this is where I work, or this person is my wife, etc..) Google Now is great at doing searches - it's basically a glorified searchbot with extra functions. At least with Siri I can ask which search engine to use (not stuck with just Google and what Google thinks their real clients - the ones paying to display you ads - want you to see....)

posted on 08 Feb 2015, 03:27 2

25. emanuelwooten (unregistered)


apple was to first to do it right. i know siri is the best and i dont even own an iphone lol.

posted on 08 Feb 2015, 07:54 2

36. Liveitup (Posts: 1798; Member since: 07 Jan 2014)


Both of you are wrong. Bing " Tell Me" was the first VA on smartphones.

In any case all of these VA will come out on top in different areas. Now ill like for some company to fo a complete list of things that VA should do and see who truly comes out on top. For me overall Cortana is best.

posted on 08 Feb 2015, 08:17 5

37. Napalm_3nema (Posts: 2227; Member since: 14 Jun 2013)


WP didn't launch until late 2010, so you should check your timelines. There wasn't even a "Bing" until June of 2009, the same month iOS 3.0 was released, which had voice capabilities. WP is always last to the party, if it's invited at all.

posted on 08 Feb 2015, 09:53 1

44. Liveitup (Posts: 1798; Member since: 07 Jan 2014)


Do us a favor what were the capabilities of iOS 3.0, could it text someone or call someone, explain to us exactly what it did. Too often people like yourself would claim something did this and that but they never explain in detail.

You don't need to tell me when different OS and services were released im quite aware of it.

Further more if you want to get technical about features like Microsoft Voice Command were already found on Windows mobile devices as far back as 2003.

When you say Windows Phone is always late to the party that comment is simply inaccurate, many of the features found in smartphones now were found in WP before any other OS, for eg. I recall a time when what is arguably the biggest trend in tech today (Flat UI) was only done by Windows Phone.

You should check your timelines and so called facts cause in many cases WP started the party.

posted on 08 Feb 2015, 11:03 3

47. Napalm_3nema (Posts: 2227; Member since: 14 Jun 2013)


You could do anything "Tell Me" could in iOS 3. I know, I owned a couple of WP7 devices, as well as a 3GS.

"Flat UI" isn't a feature. It doesn't provide any benefit since it is just an aesthetic.

Troll harder. WP is behind, and in 4+ years, it has all the traction of Teflon tires on ice.

posted on 08 Feb 2015, 12:19 1

53. Liveitup (Posts: 1798; Member since: 07 Jan 2014)


Okay again you are doing it could you please provide evidence to support your claim that iOS 3 could do anything WP7 could do, you saying that you owned both platforms doesn't do it for me. Evidence is what matters.

Tell me on Windows Phone 7.

https://www.youtube.com/watch?v=JxlUatGmnDA

Show me some evidence of iOS 3 doing the same as Tell Me. Not saying you are lying im just saying prove it.

Voice command was around even earlier.

Only someone short-sighted could say that Flat UI doesn't provide any benefit, if that was the case why is everyone adopting it, ask yourself, aesthetic itself a benefit, it focuses on beauty.

Read up about some of the advantages of Flat UI.

http://graphicdesignjunction.com/2013/05/flat-designing-and-its-advantages/

You clearly lack the understanding of what a troll is. Only thing that 4 years behind is your insight.

posted on 08 Feb 2015, 11:04

48. 14545 (Posts: 1605; Member since: 22 Nov 2011)


Both of who are wrong? I never said anything about being first, just that Apple didn't do anything first. Windows Mobile and Symbian were more advanced than iOS, even up until iOS7. I'm just sick of the Apple cult thinking their brand created everything.

posted on 08 Feb 2015, 12:14

52. Napalm_3nema (Posts: 2227; Member since: 14 Jun 2013)


Right, which is why Microsoft decided to redesign their OS after the iPhone dropped and why Nokia abandoned all of their platforms for WP. Whatever helps you sleep at night.

posted on 08 Feb 2015, 15:59 1

60. 14545 (Posts: 1605; Member since: 22 Nov 2011)


Did you use either of those operating systems? Serious question? If you didn't, then you don't have a clue. Which most of the apple cult doesn't. Actually, Windows regressed in the conversion from WinMo to WP. But people bought apple because they were already locked into the apple ecosystem and thought it was the "best" because.....welll.........apple.

posted on 08 Feb 2015, 12:24 1

54. Liveitup (Posts: 1798; Member since: 07 Jan 2014)


You are correct you didn't mention anything about being first. I apologize..

posted on 09 Feb 2015, 02:14

64. AlikMalix (Posts: 6287; Member since: 16 Jul 2014)


I like your idea...

1. Control/toggle settings
2. Find people
3. Remember who your parents, kids, siblings, co-workers, and frequent people you socialize with
4. Set up meetings, and reservations
5. Search for info from more than just Google
6. Initialize apps, texts, calls, emails as well as read them to you, modify them and reply
7. Store information that you want it to remember
8. Know when to give you audio feedback and when not to: while in car vs. while in the store.
9. Take Notes
10. Find Apps and install them
11. Find/recognize music and install/buy them
12. Search for particular photo/text/contact/document/etc..
13. Find and provide info from other devices on your cloud
14. Support dictation and commands in other languages
15. Find locations, and provide directions, ETA,
16. Find business info and make a call on your behalf or route directions.
17. Be used to control your car, house, and appliances
18. And ofcourse other basic things like weather, sports, traffic

posted on 08 Feb 2015, 08:47

40. -box- (Posts: 3991; Member since: 04 Jan 2012)


Plus Symbian and others had voice commands before even android did. I remember using my Nokia with Symbian and telling to to call a certain contact and it would. It was rudimentary, but there. IIRC it was before android and iphonies were even being sold.

posted on 09 Feb 2015, 02:36

65. AlikMalix (Posts: 6287; Member since: 16 Jul 2014)


When poeple refer to these WebOS and Symbians -- what phones are they on now? do they also have a touchscreen, ecosystems with apps and integration with homes/cars/health, etc...? Accessories such as pens, construction equipment, and other things... ? I understand BB and WP? but I dont see the relevance of WebOS and Symbian - it's like saying Hey there are these other cars besides Toyota's,BMW's and etc... they have wheels and doors, but you gotta pedal and they dont have ability to drive on modern roads... I have never heard of these WebOS and Symbians until someone started to disprove iDevices that they were not first at something and for obvious resons - Android has been second to every tech that builds the backbone of our modern personal devices....

posted on 08 Feb 2015, 00:19 6

8. LetsBeHonest (Posts: 1484; Member since: 04 Jun 2013)


http://www.phonearena.com/news/Google-Now-vs-Siri-vs-Cortana-showdown_id59877
I'm confused which one is the best.

posted on 08 Feb 2015, 00:43 3

13. tedkord (Posts: 12222; Member since: 17 Jun 2009)


It depends. Overall, GN>Cortana>Siri. But each has it's strengths and weaknesses. And I think Cortana is improving the most the quickest.

posted on 08 Feb 2015, 00:55 3

15. ihavenoname (Posts: 1693; Member since: 18 Aug 2013)


GN and Cortana are definitely more useful, though neither of them match the personality of Siri. GN wins Cortana for me by having Google as a search engine. So GN>Cortana>Siri.

posted on 08 Feb 2015, 09:45

42. fcjan (Posts: 8; Member since: 21 Oct 2014)


you are all wrong, I had voice comand on my Ericsson T29s from 2001.

posted on 08 Feb 2015, 12:54

57. lyndon420 (Posts: 4559; Member since: 11 Jul 2012)


Google has...you should try it.

posted on 07 Feb 2015, 23:51 3

2. Settings (Posts: 1718; Member since: 02 Jul 2014)


If it's in Filipino, Siri, Google NOW and Cortana would all fail.

Want to comment? Please login or register.

Latest stories