Proceedings of the Annual Meeting of the Cognitive Science Society

Disparate impact rules are formally neutral but indirectly discriminate against protected groups (i.e., by targeting a characteristic that is more prevalent in a given group). Because these rules are not obviously malicious, they have been widely enacted to circumvent policies against explicit discrimination. In a series of four experiments, we show that adults and children are sensitive to the moral implications of disparate impact rules. However, we also find that they are more accepting of these rules when strong justification is provided, compared to rules with no justification. Crucially, demographic differences also impact people's judgments of disparate impact rules and their creators. We find that conservatives and those from groups not directly affected by the rule tend to be more accepting of it. By studying people's reasoning about disparate impact rules, this work aims to identify the mechanisms by which these rules may evade detection. Finally, we discuss how these insights may inform the development of interventions that highlight the problematic effects of indirectly discriminatory policies.