Google Assistant Tops Loop Ventures Annual Digital Assistant IQ Test for 2019

For the second year in a row, Google Assistant has topped Loop Ventures Annual Digital Assistant IQ Test for 2019, correctly answering 93% of questions vs. Siri at 83%, and Alexa at 80%. Improvements were seen across the three leading digital assistants as compared to last year, each of which was asked 800 questions.

As part of our ongoing effort to better understand the practical use cases of AI and the emergence of voice as a computing input, we regularly test the most common digital assistants and smart speakers. This time, we focused on smartphone-based digital assistants.

We have eliminated Cortana from our test due to Microsoft’s recent shift in Cortana’s strategic positioning.

Testing was conducted using Siri on iOS 12.4, Google Assistant on Pixel XL running Android 9 Pie, and Alexa via the iOS app. Each digital assistant was asked the same 800 questions and then graded on two metrics i.e. Did it understand what was being asked, and did it deliver a correct response.



The question set, designed to comprehensively test a digital assistant’s ability and utility, was also broken into 5 categories:

• Local – Where is the nearest coffee shop?
• Commerce – Order me more paper towels.
• Navigation – How do I get to Uptown on the bus?
• Information – Who do the Twins play tonight?
• Command – Remind me to call Jerome at 2 pm today.

Google Assistant was once again the best performer, correctly answering 93% and correctly understanding all 800 questions. Siri was next, answering 83% correctly and only misunderstanding two questions. Alexa correctly answered 80% and only misunderstood one.

Detailed results of the test can be found on the source page.