Putting Chatbots to the Test: Does the User Experience Score Higher with Chatbots Than Websites?
Chatbots are robots that simulate conversation with human users through instant messaging services. Though the technology is innovative and trendy, what kind of user experience do they provide? To answer this, we conducted an exploratory study with chatbots from different sectors of activity on Facebook Messenger. We invited ten participants to complete six precise search tasks using these chatbots and the corresponding websites from each brand. Based on observation and interviews according to a qualitative approach, our study shows that the user experience scores higher with websites than chatbots, while abandonment rate is higher with chatbots, even though they generate more positive emotions. As a conclusion, until artificial intelligence improves the technology, chatbots have some catching up to do as they are do not score higher than websites to fulfill users’ expectations.
KeywordsChatbots User experience Online consumer behavior Websites
- 2.Lund, A.M.: Measuring usability with the USE questionnaire. Usability Interface 8(2), 3–6 (2001)Google Scholar