Abstract
This study explored the criteria for evaluating human–chatbot collaboration in customer service using the socio-technical systems theory. Interviews with 28 customer service managers, conversational designers, and human agents revealed their evaluation criteria diverged. Managers prioritized the chatbot’s technical capabilities and preferred a standalone customer service chatbot, while conversational designers prioritized the social aspect, focusing on the chatbot as a support tool for human agents and customers. Human agents mainly evaluated the chatbot as a means to increase job satisfaction. These distinct criteria highlight the importance of an aligned approach in human–chatbot collaboration. To improve this collaboration, integrating the chatbot into customer data systems was suggested.
Funding Information
  • the Nederlandse Organisatie voor Wetenschappelijk Onderzoek (KIVI.2019.009, 2020)

This publication has 46 references indexed in Scilit: