Skip to main content

Statistical Methods for Testing and Evaluating Defense Systems Interim Report (1995) / Chapter Skim
Currently Skimming:

2 Use of Experimental Design in Operational Testing
Pages 15-23

The Chapter Skim interface presents what we've algorithmically identified as the most significant single chunk of text within every page in the chapter.
Select key terms on the right to highlight them within pages of the chapter.


From page 15...
... A special aspect of DoD operational testing is the expense of the systems and the individual test articles involved. Even modest gains in operational testing efficiency can result in enormous savings either by correctly identifying when there is a need for cancellation, passing, or redesign of a system, or by reducing the need for test articles that can cost millions of dollars each.
Read the entire page →
From page 16...
... After considering the current systems under test by OPTEC, the panel decided to examine the operational testing of the Apache Longbow helicopters iThe panel is extremely grateful for the cooperation of OPTEC in this activity, especially Henry Dubin, Harold Pasini, Carl Russell, and Michael Hall.
Read the entire page →
From page 17...
... Either zero, two, or three replications were selected for combinations of mission type with day/night; zero replications was chosen for impossible combinations (for example, deep attacks are not carried out during daylight because of the formidable challenges to achieving significant penetration of enemy lines during periods of high visibility.) The panel continued its examination of the Apache Longbow' s operational testing through a presentation by OPTEC staff outlining the evaluation of the test results after the testing had been completed.
Read the entire page →
From page 18...
... For example, if one is testing to find faults, it is better to use experimental designs that "rig" the test in informative ways. As a further complication, operational tests can be used to calibrate and evaluate simulation models, and the design implications may be different for those objec 2A scoring conference is a group of about six to eight people including testers, evaluators, and representatives of the program manager who review information about possible test failures and determine whether to count such events as failures or exclude them from the regular part of the test evaluation.
Read the entire page →
From page 19...
... However, the failure modes and failure rates of operational testing tend to be different than those of developmental testing.3 CASE STUDY #2: THE ATACMS/BAT SYSTEM In the Army Tactical Missile System/Brilliant Anti-Tank (ATACMS/BAT) system, OPTEC proposes to use a relatively novel test design in which a simulation model, when calibrated by a small number of operational field tests, will provide an overall assessment of the effectiveness of the system under test.
Read the entire page →
From page 20...
... This approach has been taken because budgetary limitations on the sample size and the limited availability of equipment such as radio-controlled tanks for testing make it infeasible to develop a program of field testing that could answer the key questions about the performance of this system in a real operational testing environment. Operational testing of the ATACMS/BAT system is scheduled to take place in 1998.
Read the entire page →
From page 21...
... lists eight test events that vary according to such factors as range of engagement, target location error, logic of targeting software, type of tank formation, aimpoint, time of day, tank speed and spacing, and threat environment. Three levels are specified for the range of engagement: near minimum, near maximum, and a medium range specified as either "213s" or "ROC," the required operational capability.
Read the entire page →
From page 22...
... 22 · _ Cal o Us: Cal C)
Read the entire page →
From page 23...
... will continue to follow progress in the design of the operational test for the ATACMS/BAT system. We will also devote some additional effort to understanding the use of experimental design in operational testing in industry and in nonmilitary federal agencies.
Read the entire page →

Key Terms

  • operational testing
  • experimental design
  • apache longbow
  • test design
  • hit rate

  • operational tests
  • dod operational
  • percent hit
  • fractional factorial
  • evaluation master

  • shot matrix
  • field tests
  • master plan
  • tactical missile
  • army tactical

  • testing program
  • test scenarios
  • developmental testing
  • army operational
  • longbow helicopter

  • design techniques
  • test articles
  • test events
  • acoustic detection
  • simulation model

  • longbow operational
  • relatively novel
  • optec approach
  • mode summary
  • deliberate attack


    • This material may be derived from roughly machine-read images, and so is provided only to facilitate research.
    More information on Chapter Skim is available.