How Is Your User Feeling? Inferring Emotion Through Human-Computer Interaction Devices1
Authors: Hibbeln, Martin; Jenkins, Jeffrey L.; Schneider, Christoph; Valacich, Joseph S.; Weinmann, Markus
Journal: MIS Quarterly (2017)
DOI: 10.25300/misq/2017/41.1.01
Emotion can influence important user behaviors, including purchasing decisions, technology use, and customer loyalty. The ability to easily assess users’ emotion during live system use therefore has practical significance for the design and improvement of information systems. In this paper, we discuss using human–computer interaction input devices to infer emotion. Specifically, we utilize attentional control theory to explain how movement captured via a computer mouse (i.e., mouse cursor movements) can be a real-time indicator of negative emotion. We report three studies. In Study 1, an experiment with 65 participants from Amazon’s Mechanical Turk, we randomly manipulated negative emotion and then monitored participants’ mouse cursor movements as they completed a number-ordering task. We found that negative emotion increases the distance and reduces the speed of mouse cursor movements during the task. In Study 2, an experiment with 126 participants from a U.S. university, we randomly manipulated negative emotion and then monitored participants’ mouse cursor movements while they interacted with a mock e-commerce site. We found that mouse cursor distance and speed can be used to in…