Skip to main content

Currently Skimming:

II.6 Making and Using Lists of Empirically Tested Programs: Value for Violence Interventions for Progress and Impact--Patrick H. Tolan
Pages 94-106

The Chapter Skim interface presents what we've algorithmically identified as the most significant single chunk of text within every page in the chapter.
Select key terms on the right to highlight them within pages of the chapter.


From page 94...
... , and which programs lack determination (mixed results from sound evaluations or no sound evaluations)
From page 95...
... Additionally, reliable lists can enable efficient use of funding because development and implementation requirements would be known, saving funds and time when compared to untested and unspecified programs or local initiatives developed de novo. This paper outlines the rationale and important criteria for developing a practical, efficacious list for violence reduction and prevention, and notes critical challenges in developing a useful approach.
From page 96...
... . Although considerable debate exists about developing lists of programs versus systematically identifying key features or practices through metaanalyses, there are several reasons lists may provide the best guidance (Advisory Board of Blueprints for Violence Prevention, 2011; Valentine et al., 2011)
From page 97...
... The Great Advantage of Random Assignment Trials for Determining Evaluation Effects When program evaluations are identified, there is a second immediate consideration: whether the evaluation material available is of sufficient methodological quality to permit appropriate inference of effects (or lack thereof)
From page 98...
... If, for example, a violence prevention effort requires direct and open discussion of partner violence, it could result in those in the intervention condition leaving if they are engaged in more serious violence because of threat of arrest. This would render a difference between intervention and comparison condition that could explain any effects found, despite initial random assignment.
From page 99...
... can also render an evaluation with randomized design to no longer permit a sound interpretation of an intervention result as causal. Features Other Than Collapse of Random Assignment Can Render an Evaluation Unusable Other features of an evaluation, while not directly a failure of randomization or of adequate control for comparability for effects, can render a given evaluation not usable for determining a program's effects or lack of effects (Maxwell, 2004)
From page 100...
... Eschewing standards will not lead to sound program choice guidance. If viewed as basic requisites for judging the use of scientific standards, then these challenging requirements may be seen, nonetheless, as necessary for developing a reliable, valid, and transparently rendered roster of programs that can be used for violence intervention.
From page 101...
... A second limitation is that, to date, these review and listing efforts have been concentrated on youth violence perpetration, not on youth violence victimization or intimate partner violence, child abuse, or elder abuse
From page 102...
... Systematically review reports for evaluation methodology quality to be included for consideration 3. Those meeting study design quality standards to validly evaluate effects reviewed by independent advisory board 4.
From page 103...
... In addition to concentrated efforts to improve evaluation confidence, there does seem to be value in preferring programs with adequate evaluation and evidence of positive effects over those without such evidence. A third criticism raised about the development of lists with the scientific standards used in other areas of health care is that many established efforts would need to be dropped in favor of efforts that may not have community support.
From page 104...
... Because such interventions involve randomizing large units and therefore often larger costs and administration requirements, the scale needed for valid randomized controlled trials can be daunting. To ensure inclusion of such interventions, some consideration of these factors seems warranted.
From page 105...
... Program Lists and Moving Forward in Violence Intervention This report has focused on Blueprints as an exemplary approach to violence prevention because it is a transparent, sound, and reliable standard that has many advantages over other approaches to list development and other efficacious approaches to identifying preferable programs and practices. However, as noted, there is a need for much more evaluation, including multiple evaluations of most promising approaches and model programs.
From page 106...
... Box II-3 provides a summary of the characteristics for an "ideal" evidence-based program. Continuing to pursue this ideal and to promulgate sound lists can be an important contributor to effective violence intervention.


This material may be derived from roughly machine-read images, and so is provided only to facilitate research.
More information on Chapter Skim is available.