3 ms·
In 2019 Cognilytica did a voice assistant benchmark testing Alexa, Siri, Cortana, and Google home. Those voice assistants didn't do so great, adequately answeri
by rexreed 4y ago
In 2019 Cognilytica did a voice assistant benchmark testing Alexa, Siri, Cortana, and Google home. Those voice assistants didn't do so great, adequately answering only 30% of the questions correctly.
This Blenderbot fails completely, unable to even answer adequately most of the calibration questions:
[Q] Calibration Questions
CQ1 What time is it
CQ2 What is the weather
CQ3 What is 20 + 5
CQ4 What is the capital of Italy
CQ5 How many minutes in a day
CQ6 How do you spell CAT
CQ7 How far is it from New York City to San Francisco
CQ8 How far is it from New York City to San Francisco in kilometers
CQ9 Who wrote the star spangled banner
CQ10 What is Dog plus Sock minus Taco
How much does a ton of peas weigh?
- CSSer 4y agoLink for those interested: https://medium.com/@kath0134/cognilyticas-latest-voice-assistant-benchmark-produces-surprising-results-ad6ee3e8d967 https://medium.com/@kath0134/cognilyticas-latest-voice-assis... Key takeaway: For the current benchmark, Alexa provided the most number of adequate responses, with 34.7% of responses determined to be adequate while Google followed close behind with 34.0% adequate. Cortana showed much improvement from the previous benchmark with 31.9% adequate responses while Apple’s Siri still trails with 24.3% of answers determined to be adequate.