How does exposure to criminal violence shape attitudes towards justice and the rule of law? Citizens care about crime prevention and procedural legality, yet they also value punishing perpetrators for the harm they have done. We argue that anger induced by exposure to criminal violence increases the demand for retribution and harsh punishments, even at the expense of the rule of law. We test this theory using one observational and two experimental studies from an original survey of 1,200 individuals in Western Mexico, a region affected by organized criminal violence and vigilantism. First, we first show that exposure to violence is correlated with increased anger and support for punitive justice, including vigilante actions. Second, across our two experiments, we show that citizens are more supportive of harsh punishments and place less value on their legality in response to morally outrageous crimes. Third, we find that the innocence of the victim, rather than the severity of the crime, is what triggers outrage and punitiveness. This suggests that citizens may support extreme levels of violence as long as they perceive that its targets are criminals. Finally, we show that outrageous forms of violence against civilians can lead individuals to prioritize harsh punishment regardless of its legality. When criminal actors target perceived innocents with common crimes like extortion, there is greater support for harsh, vigilante action. These patterns provide a bottom-up explanation for harsh justice.