Improving Metrics for the Department of Defense Cooperative Threat Reduction Program (2012) / Chapter Skim
Currently Skimming:
2 Committee Assessment of the Department of Defense Cooperative Threat Reduction Metrics Report
2 Committee Assessment of the Department of Defense Cooperative Threat Reduction Metrics Report
Pages 17-28
The Chapter Skim interface presents what we've algorithmically identified as the most significant single chunk of text within every page in the chapter.
Select key terms on the right to highlight them within pages of the chapter.
From page 17... ...
Different metrics may be appropriate for different stages of program and project development, but they all need to be tied together by the strategic objectives of the program as they fit with broader DoD Cooperative Threat Reduction objectives. The committee evaluated the DoD CTR metrics described in the (CTR)
|
From page 18... ...
Enhance partner country capability to perform WMD capability to detect WMD detection Number of personnel trained and 5. Enhance partner country capability to perform border equipped to perform border security security interdiction interdiction 6.
|
From page 19... ...
Although measures of effectiveness and impact are the most challenging and should continue to receive the most attention, measures of efficiency and cost-effectiveness are also necessary and should be included in future iterations of the CTR Program metrics.17 OVERALL ASSESSMENT The DoD Metrics Report contains reasonable metrics for the CTR programs aimed at consolidation and elimination of weapons and weapons materials, and contains a reasonable starting point for developing metrics for the newer capacity-building programs. 16 It may not be possible to directly measure the higher-level outcomes from some CTR programs or projects, even with the best metrics.
|
From page 20... ...
As a consequence, the DoD Metrics Report mixes project management measures with higher-level program performance metrics for some of the CTR programs, and weights equally metrics that are critically important and others are not. Cooperation DoD plans to leverage other United States Government agencies' experience, capabilities, and assets as CTR expands to new countries and as it continues existing programs.
|
From page 21... ...
Furthermore, the CTR Program will be working with these other agencies in a whole-of-government effort, and the others might already have mechanisms in place for measuring impact and effectiveness that would be useful to CTR. Change The DoD Metrics Report deliberately does not consider future missions or changes in objectives, but it is difficult to see how CTR metrics can be designed to respond to change if this is not discussed in DoD's report.
|
From page 22... ...
Worker safety and environmental emissions are also important indicators of proper operation of the facility, but are not mentioned in the DoD Metrics Report. In a facility that has strong regulatory controls and/or strong internal management controls on safety and environmental performance, problems with safety or environmental releases affect the operation of the facility, i.e., the facility will shut down some or all of its operations to correct problems.
|
From page 23... ...
project metrics. a Not available in the DoD Metrics Report but available in other documents.
|
From page 24... ...
The CBEP objectives and desired capabilities are clearly stated, although their connection to threat reduction is not stated in the DoD Metrics Report. The metrics are linked to the desired partner country capabilities, and some of them measure impacts and effectiveness, although others do not.21 DoD also factors sustainability into its rating of the program's performance.
|
From page 25... ...
The DoD Metrics Report also states that "with the potential global expansion of the NWSS program to other partner countries, Defense Threat Reduction Agency DTRA has been working to develop enhanced metrics that better reflect how our efforts are contributing to overall threat reduction." The current NWSS program has severe constraints on measurements. The CTR program trains people who train the operators of the nuclear weapons storage sites, but the CTR training takes place at facilities away from the nuclear weapons storage sites, and CTR personnel do not have access to any of the sites.
|
From page 26... ...
• Number of ports of entry provided sustainable capability enhancements (in progress/complete) In introducing these metrics, the DoD Metrics Report notes: "The ability to measure simply and objectively the impact that WMD-PPP assistance has had on threat reduction is challenging due to the nature of the program: we are providing a capability to our partners that gives them an ability to deter proliferation." DoD articulates both program and project objectives for the WMD-PPP.
|
From page 27... ...
At a project level, the metrics in the DoD Metrics Report are better linked to the capabilities desired. Some of the project metrics DoD developed for the WMD-PPP measure impacts and effectiveness, such as alerts resulting in a positive outcome, and others do not, such as the number of maintenance personnel trained.
|
Key Terms
This material may be derived from roughly machine-read images, and so is provided only to facilitate research.
More
information on Chapter Skim is available.