Testing shows Siri beating out Google Now and Cortana for accuracy, user satisfaction and more
The four questions that testers asked their assistant were: Who won the Super Bowl in 1978?, How many calories in a muffin?, Where can I buy tires? and When is "Kung Fu Panda 3" coming out? The three tasks were: Ask your phone to set an appointment, Turn the Wi-Fi setting on, and Send a text message.
Siri received high marks from users for answering the questions. For example, when the three assistants were asked the question about who won the Super Bowl in 1978, Siri answered correctly 95.3% of the time. 86.1% of users were satisfied with the response. While Google Now had the correct answer 88% of the time, 80% of the time it responded with a web search. Cortana gave the wrong answer 3.3% of the time.
When users asked their personal assistant to set up an appointment, Siri did it correctly during 92.3% of the attempts. 89.2% of users were satisfied with the response. Those two figures for Google Now were 81.3% and 80%. Cortana set the appointment up correctly 73.3% of the time, with 70% of the Windows Phone users satisfied with her response.
Overall, Siri had the fewest incorrect answers (2.4%), the highest number of satisfied users (81%), the lowest number of follow-up questions (5.2%) and was tied with Google Now for having the lowest percentage of answers that were in the form of a web search (5%). Google Now was second in the test, with Cortana third. Google Now (68%) and Cortana (57%) had low satisfaction scores compared to Siri, which has to be concerning for Google and Microsoft.
Interestingly, those living in the Western states gave higher satisfaction scores to Siri, while those living in the East gave higher satisfaction scores to Google Now and Cortana. Additionally, women using Cortana and Google Now received follow-up questions twice as often as men. This might have to do with the way that women using the two personal assistants structured their questions and task requests. Siri, on the other hand, asked follow-up questions of men more often than women.
source: ExpertsExchange via WMPoweruser
Posts: 3723; Member since: Aug 16, 2011
posted on Nov 09, 2015, 5:46 PM 10
posted on Nov 09, 2015, 9:06 PM 3
posted on Nov 09, 2015, 10:04 PM 3
Posts: 2540; Member since: Sep 03, 2013
posted on Nov 09, 2015, 5:49 PM 3
Posts: 3487; Member since: Oct 26, 2012
posted on Nov 10, 2015, 6:44 AM 0
Posts: 5029; Member since: Mar 30, 2015
posted on Nov 10, 2015, 8:22 AM 1
Posts: 14967; Member since: Sep 25, 2013
posted on Nov 10, 2015, 10:56 AM 0
Posts: 1169; Member since: Aug 23, 2012
posted on Nov 09, 2015, 6:00 PM 2
Posts: 644; Member since: Jun 05, 2015
posted on Nov 09, 2015, 11:18 PM 0
posted on Nov 10, 2015, 4:49 AM 1
Posts: 6474; Member since: Jan 28, 2013
posted on Nov 09, 2015, 6:46 PM 1
posted on Nov 09, 2015, 9:09 PM 3
PhoneArena Comments Rules
A discussion is a place, where people can voice their opinion, no matter if it is positive, neutral or negative. However, when posting, one must stay true to the topic, and not just share some random thoughts, which are not directly related to the matter.
Things that are NOT allowed:
- Off-topic talk - you must stick to the subject of discussion
- Trolling - see a description
- Flame wars
- Offensive, hate speech - if you want to say something, say it politely
- Spam/Advertisements - these posts are deleted
- Multiple accounts - one person can have only one account
- Impersonations and offensive nicknames - these accounts get banned
Moderation is done by humans. We try to be as objective as possible and moderate with zero bias. If you think a post should be moderated - please, report it.
Have a question about the rules or why you have been moderated/limited/banned? Please, contact us.
Send a warning to post author
Send a warning to Selected user.
The user has 0 warnings currently.
Next warning will result in ban!
Ban user and delete all posts
Message to PhoneArena moderator (optional):