Skip to main content

Currently Skimming:

7 On the Use of Aggregate Crime Regressions in Policy Evaluation--Steven N. Durlauf, Salvador Navarro, and David A. Rivers
Pages 211-242

The Chapter Skim interface presents what we've algorithmically identified as the most significant single chunk of text within every page in the chapter.
Select key terms on the right to highlight them within pages of the chapter.


From page 211...
... Rivers Despite recent efforts to employ microeconomic data and natural experiments, aggregate crime regressions continue to play a significant role in criminological analyses. One use of these regressions is predictive, as illustrated by the papers in this volume that employ aggregate crime trends regressions -- Baumer (Chapter 5)
From page 212...
... We then apply our general arguments to areas in the empirical criminology literature: the convergence of crime rates, capital punishment, and shall-issue concealed weapons laws. The next section discusses whether the limitations that exist in using crime regressions mean that they should be replaced by quasi-experimental methods, and a final section concludes the chapter.
From page 213...
... Their behavior is forward looking, and it is also assumed to be consistent over time. In particular they try as best they can to anticipate the consequences of their actions." To see how crime choice may be formally described, we follow the standard binary choice model of economics.
From page 214...
... (4) This conditional probability structure captures the microfoundations of the economic model we wish to study.
From page 215...
... from choice-based foundations illustrates how standard aggregate crime regressions require a number of statistical assumptions if they are to be interpreted as aggregations of individual behavior. The assumption of a uniform density for the individual specific heterogeneity is of concern; in order to ensure that the probabilities of each choice are bounded between 0 and 1, the support of the uniform density may need to be agent-specific. Unfortunately, other random utility speci   See Aldrich and Nelson (1984, Chapter 1)
From page 216...
...   i ,t l ,t i ,t l ,t l ,t  ) the various payoff components but will not produce a closed form solution for the aggregate crime rate.
From page 217...
... MODEL UNCERTAINTY Our derivation of aggregate crime rates from microfoundations assumed that the researcher had strong prior information about the individual decision process. Put differently, our derivation of an aggregate crime regression
From page 218...
... These categories are meant to identify general types of model uncertainty that are common in social science analyses. At the same time, our decomposition of model uncertainty is not unique; one can well imagine alternative divisions.
From page 219...
... Specifically, Black and Nagin (1998) found that the use of quadratic time trends in place of state-specific linear time trends eliminates the evidence of a link between liberalization of concealed weapons laws and crime rates found in Lott and Mustard (1997)
From page 220...
... Exchangeability, roughly speaking, captures the idea that observations, such as state-specific crime rates, may be treated as draws from a common statistical process. One example of sensitivity of empirical claims to assumptions about parameter heterogeneity is again found in the controversy between Black and Nagin and Mustard and Lott.
From page 221...
... . An application to a crime context, the deterrent effect of capital punishment, is Cohen-Cole et al.
From page 222...
... For example, Horowitz argues that in order to use cross-county data to evaluate the average effect of shall-issue laws, if there are differences between the states, so that the crime rate in a county is determined by some set of factors X, then in order to identify the effect of the laws "one must use a set that consists of just the right variables and, in general, no extra ones." But as shown in Heckman and Navarro (2004) , this is true only for a particular set of empirical strategies known as matching, of which linear regression is a special case.
From page 223...
... POLICY-RELEVANT CALCULATIONS Basic Ideas In this section, we explicitly consider the relationship between statistical models and policy evaluation from a decision-theoretic perspective. The fact that statistical significance levels do not equate to policy statements is well known (see Goldberger, 1991, for a nice discussion)
From page 224...
... report. Model Averaging and Policy Evaluation When model uncertainty is present, the optimal policy calculation equation (13)
From page 225...
... Unlike the case of the social scientist, the model has no intrinsic interest to a policy maker; it is simply an additional source of uncertainty in the effects of a policy. Beyond Model Averaging Once model uncertainty is involved in policy evaluation, new considerations can arise.
From page 226...
... APPLICATIONS TO CRIMINOLOGY ISSUES In this section, we apply some of our general arguments to current controversies in criminology. Convergence in Crime Rates A first example in which more careful attention is needed to the determinants of aggregate crime regressions involves efforts to evaluate convergence among aggregate crime rates.
From page 227...
... If one considers the determinants of female crime rates, there is no reason to believe that the changes between 1960 and 1975 are simply another draw from the same process generating the changes between 1975 and 1990. Similarly, LaFree's evaluation of convergence between industrializing poor nations and industrialized rich ones assumes that intracountry homicide rate changes are generated by a second-order stationary process.
From page 228...
... O'Brien is relatively circumspect in interpreting his results, but even his speculations on how to explain the finding of no convergence in homicide with convergence in other crimes are not justifiable, since without a theory as to why unconditional convergence is to be expected, there are so many ways to differentiate the experiences of men and women that it is not clear whether there is a fact to be explained. As for LaFree, if there are factors outside the modernization process that determine crime rates -- and obvious candidates include socioeconomic factors, such as levels of unemployment and inequality, demography, and differences in national criminal justice systems -- then the absence of unconditional convergence does not speak to the empirical relevance of modernization or any other theory considered in isolation.
From page 229...
... Microfoundations From the perspective of our first argument, that aggregate models should flow from aggregation of individual behavioral equations, the Dezhbakhsh, Rubin, and Shepherd specification can be shown to be flawed. Specifically, the way in which probabilities are used does not correspond to the probabilities that arise in the appropriate decision problem.
From page 230...
... The decision to commit a homicide, under the economic model of crime, depends on the entire range of penalties and their associated probabilities. Changes in the rates at which murderers are sentenced to life imprisonment without parole, for example, are not accounted for by Dezhbakhsh, Rubin, and Shepherd or, as far as we know, any other capital punishment deter
From page 231...
... , then it is no longer clear what it means to say that a Dezhbakhsh, Rubin, and Shepherd-type regression provides evidence on the effects of capital punishment. Does an increase in long prison sentences because of death sentences followed by reversals correspond to what is understood to be the deterrent effect of capital punishment?
From page 232...
... argue that evidence of a deterrent effect can produce a moral case for capital punishment, in that the decision of a government to fail to implement a life-saving policy is equivalent to the decision to implement a policy that costs lives. Sunstein and Vermeule (2005)
From page 233...
... Rather, our claim is that the policy implications of the uncertainty associated with deterrence effects cannot be assessed outside of the policy maker's preferences. Right-to-Carry Laws and Crime: Firearms and Violence Revisited Our third example is the controversy over the effects of shall-issue concealed weapons laws in the National Academies report Firearms and Violence (National Research Council, 2005)
From page 234...
... The disagreement between Wilson and the rest of the National Academies committee reflects the absence in the report of an explicit evaluation of how model uncertainty interacts with evidence of shall-issue laws. While the assertion that it is impossible to statistically identify the correct specification of a statistical model is true at some level of generality (although the report is frankly unclear on what is meant by this)
From page 235...
... One answer to our advocacy of model averaging as a tool to address model uncertainty of the type facing the National Academies committee is that a given body of empirical studies captures only a small fraction of the universe of potential models (and indeed might represent a measure 0 set)
From page 236...
... And we do not know, given our priors, how the relative goodness of fit of the different models analyzed in the National Academies report would translate into different posterior model probabilities. Our discussion of the assumptions that underlie the interpretation of aggregate crime regressions may all be interpreted as examples for H ­ orowitz's arguments about the limitations of regression analysis of crime.
From page 237...
... Overall, we do not see good reasons to regard natural experiments as superior to regressions with observational data in terms of their relative utility as means of understanding crime.10 It is straightforward to construct examples in which one methodology can provide insights that the other does not. Each has a contribution to make in criminological research.
From page 238...
... . Econometric evaluation of social programs, part III: Distributional treatment effects, dynamic treatment effects, dynamic discrete choice, and general equilibrium policy evaluation.
From page 239...
... . Model uncertainty and policy evaluation: Some theory and empirics.
From page 240...
... . The effect of prison population size on crime rates: Evidence from prison overcrowding litigation.
From page 241...
... . Is capital punishment morally required?


This material may be derived from roughly machine-read images, and so is provided only to facilitate research.
More information on Chapter Skim is available.