NCJ Number
251219
Date Published
November 2011
Length
17 pages
Annotation
This guide explains the key concepts in outcome evaluation research in order to help practitioners distinguish between good-quality and poor-quality evaluation reports.
Abstract
The guide first defines "evaluation" as a "systematic and objective process for determining the success or impact of a policy or program." Key issues that can help practitioners to distinguish between good and poor evaluations are then discussed. The first issue considered is the role of evaluation design in identifying the factors that produce measured outcomes. Some evaluation designs are better than others in demonstrating the causes of program outcomes. The discussion of various evaluation designs focuses on some of the most common approaches used in the evaluation of criminal justice policies and programs. The evaluation designs are divided into three major categories based on their characteristics: 1) experimental, 2) quasi-experimental, and 3) non-experimental. The features of each of these evaluation designs are described, along with their advantages and disadvantages compared with the others. The second major issue discussed is how well the evaluation is conducted. This is important, because regardless of the design being used, its value is determined by whether the basic evaluation design is properly conducted, from the data collection to the analysis and the reporting of the results. This section of the guide discusses the major issues that must be considered when assessing how well the evaluation design was implemented. After discussing the basic issues of evaluation design and how well the design is implemented, the guide discusses some additional activities that may accompany the basic evaluation. These activities include a cost-benefit analysis, meta-analyses, and systematic reviews. A checklist is provided for applying the guide's information to a particular evaluation. 3 figures and 7 references