Testing shows Siri beating out Google Now and Cortana for accuracy, user satisfaction and more
posted by Alan F. / Nov 09, 2015, 5:39 PM
The four questions that testers asked their assistant were: Who won the Super Bowl in 1978?, How many calories in a muffin?, Where can I buy tires? and When is "Kung Fu Panda 3" coming out? The three tasks were: Ask your phone to set an appointment, Turn the Wi-Fi setting on, and Send a text message.
Siri received high marks from users for answering the questions. For example, when the three assistants were asked the question about who won the Super Bowl in 1978, Siri answered correctly 95.3% of the time. 86.1% of users were satisfied with the response. While Google Now had the correct answer 88% of the time, 80% of the time it responded with a web search. Cortana gave the wrong answer 3.3% of the time.
When users asked their personal assistant to set up an appointment, Siri did it correctly during 92.3% of the attempts. 89.2% of users were satisfied with the response. Those two figures for Google Now were 81.3% and 80%. Cortana set the appointment up correctly 73.3% of the time, with 70% of the Windows Phone users satisfied with her response.
Overall, Siri had the fewest incorrect answers (2.4%), the highest number of satisfied users (81%), the lowest number of follow-up questions (5.2%) and was tied with Google Now for having the lowest percentage of answers that were in the form of a web search (5%). Google Now was second in the test, with Cortana third. Google Now (68%) and Cortana (57%) had low satisfaction scores compared to Siri, which has to be concerning for Google and Microsoft.
Interestingly, those living in the Western states gave higher satisfaction scores to Siri, while those living in the East gave higher satisfaction scores to Google Now and Cortana. Additionally, women using Cortana and Google Now received follow-up questions twice as often as men. This might have to do with the way that women using the two personal assistants structured their questions and task requests. Siri, on the other hand, asked follow-up questions of men more often than women.
source: ExpertsExchange via WMPoweruser
Posts: 3722; Member since: Aug 16, 2011
Voice assist is all well and dandy, but 99% of my search activity is through typing, and for me Google is the only way to go.
posted on Nov 09, 2015, 5:46 PM 10
Unlike Google now, you can tell Siri to search using any engine including Google!!! Typing takes too long and requires your eyes and attention - asking vice assistant is fast, requires no attention and can be dictated a long enquiry if you keep holding the home button as you ask. I can stop talking for 20 seconds or a minute (I haven't tested for longer than that) and Siri will wait until you're done dictating your enquiry. Vey important - and you don't have to think what you're about to ask before evoking the voice assistant.
posted on Nov 09, 2015, 9:06 PM 3
I loved to write in school. I enjoy leading up to a punchline and grand fenalies. I know how my posts seem. I just can't write the typical "android sucks, Apple is king" posts. I enjoy elaborating and crating a debate - unfortunately the responses are juvenile and uninspiring; I do hope to grab attention of a few that oppose my views but print a little class to conversations. I could care less how Apple does financially - I actually voiced that it would be interesting to see Apple failing or under stress to see why they would do when profits slow down - unfortunately that means I have to stop buying Apple devices and I don't want to go to android (personal choice).
posted on Nov 09, 2015, 10:04 PM 3
Posts: 2540; Member since: Sep 03, 2013
Siri has gotten better and faster with each iPhone release. The experience will vary depending on which iPhone you have. Right now, Google now just seems quicker to respond, but Siri has more personality. I can't wait to see how these things progress over the next 5 years!
posted on Nov 09, 2015, 5:49 PM 3
Posts: 3487; Member since: Oct 26, 2012
one more thing to bear in mind is for accuracy of voice assistants a lot depends on hardware as well i.e. the device you are using and since Siri is only on iPhones and iPad which have better hardware capability then an average $200 android. I'd say the difference is negligible.
posted on Nov 10, 2015, 6:44 AM 0
Posts: 5029; Member since: Mar 30, 2015
By Example Motorola phone would get better result than any iphone ever using voice assistant and voice command. the only problem here is the company thats did the test was paid by Apple to do it so they most probably chosen windows and android phone thats where inferior at the base. We just tested the moto X play vs iphone 6S in store today and i am sorry but beside in english where Siri did almost as good as moto voice when we switched in french Siri was crap. Also Google now ( on wich moto voice is based ) seem much better at translating and understanding various languages.
posted on Nov 10, 2015, 8:22 AM 1
Posts: 14967; Member since: Sep 25, 2013
Who needs personality. All Iw ant is answers that are accurate. Since I don't use Siri I can't comment. But when I use Google now, it has never been wrong. Directions is the main thing I used it for over summer while on vacation. I got very timely updates on traffic, crashes, sports teams back at home and more without even asking. Samsung's S-Voice is never mentioned. On my Gear S its awesome because the device houses the database for S-voice so I get quick results. On the phone its slower, but also very accurate. But Google Now is much faster!
posted on Nov 10, 2015, 10:56 AM 0
Posts: 1166; Member since: Aug 23, 2012
Just done the WiFi, calender and text message 5 x each and 100% there. I must have a lovely clear voice ;)
posted on Nov 09, 2015, 6:00 PM 2
Posts: 515; Member since: Jun 05, 2015
all these things quickly become crap when you're not a native English speaker (that's a lot of people)
posted on Nov 09, 2015, 11:18 PM 0
Actually Siri works extremely well in all the languages it supports and there's a lot. I can attest to certain European language that Siri does excellent in dictation, commands, searches, and every aspect of English Siri - the Eastern European Siri can do - my non English speaking family members are using it specially my grandpa - who find it easier to ask Siri to do something on the phone than to do it manually - believe it or not... Can someone tell me if they implemented Google now to understand what language is spoken (up to 5 pre selected) without the need to change it manually in settings - if that already works - that's freaked awesome and credit to Google for that. I just read that somewhere on the news a while back, curious if it's realized yet.
posted on Nov 10, 2015, 4:49 AM 1
Posts: 6474; Member since: Jan 28, 2013
Last time I checked Googlenow smoked Siri. Google can get paragraphs with no errors and Siri not so much. Of course that was a long time ago and I don't use either all that much. Either way, chalk up Siri as useless like 3D Touch is. So Touch ID is the only one actually useful and Moto did it first.
posted on Nov 09, 2015, 6:46 PM 1
Moto did it wrong. First it's in a different location (not imbedded into a button you use often). It actually kept your fingerprint itself that can be extracted which is something that is a no-no in security of things. And failure rate was horrible compared to even the first touch if on iPhone 5S.
posted on Nov 09, 2015, 9:09 PM 3
Send a warning to post author
Send a warning to Selected user.
The user has 0 warnings currently.
Next warning will result in ban!
Ban user and delete all posts
Message to PhoneArena moderator (optional):