Do Crowds Validate False Data? Systematic Distortion and Affective Polarization
Authors: Pienta, Daniel A.; Somanchi, Sriram; Vishwamitra, Nishant; Berente, Nicholas; Thatcher, Jason Bennett
Journal: MIS Quarterly (2025)
<jats:p>This research note examines how sociocognitive influences can systematically distort crowdsourced ground truth in event-centric data through subgroups. The “wisdom of the crowd” is based on the assumption that consensus drives accuracy. While existing research addresses the tendencies of the overall crowd, this research note shows that identifiable subgroups within the crowd can systematically influence crowdsource validation. We conducted an immersive experiment to investigate whether crowd consensus can be systematically distorted by subgroup-based sociocognitive influences, such as affective polarization. In the experiment, raters from a range of subgroups with varying levels of affective polarization were asked to view and validate crisis data from a violent public riot in the year 2020. Relying in part on double debiased machine learning techniques, we analyzed heterogeneous treatment effects across subgroups. The results show that affective polarization and more extreme raters, via the constructs of loyalty and betrayal, distort consensus-based ground truth in different ways. This research note demonstrates how subgroup-based sociocognitive influences can systematica…