Innovations in Software Engineering for Defense Systems (2003) / Chapter Skim
Currently Skimming:
4 Data Analysis to Assess Performance and To Support Software Improvement
4 Data Analysis to Assess Performance and To Support Software Improvement
Pages 40-50
The Chapter Skim interface presents what we've algorithmically identified as the most significant single chunk of text within every page in the chapter.
Select key terms on the right to highlight them within pages of the chapter.
From page 40... ...
It is important to use these data to improve software engineering processes, to discover faults as early as possible in system development, and to monitor system performance when fielded. The main aspects of software development and performance examined at the workshop include: (1)
|
From page 41... ...
The cost of running a software program on test case i is therefore defined to be chid if the program is run on i, and is defined to be contain otherwise, using this conservative assumption. The overall estimated risk associated with a software program, based on testing using some test suite, is defined to be the weighted sum over test cases of the product of the cost of failure acrid or costlier for test input i multiplied by the (normalized)
|
From page 42... ...
Customer i1 represents 35 percent of the business, while customer i1 0OO provides very little business. Assume a test suite of 100 cases was selected to be run using statistical testing based on the operational distribution, but only 99 cases were run (without failure)
|
From page 43... ...
.y rare in rep .lty. Similar considerations arise with deterministic selection of test suites.
|
From page 44... ...
Software agings occurs when defect conditions accumulate over time, leading to either performance degradation or software failure. It can be due to deterioration in the availability of operating system resources, data corruption, or numerical error accumulation.
|
From page 45... ...
Transitions from one state to another and sojourn times in each state are modeled using a Markov chain model. The resulting model can be used to optimize some objective function as a function of the decision rule on when to schedule rejuvenation; one specific method that accomplishes this is the symbolic hierarchical automated reliability and performance estimator.
|
From page 46... ...
ODC, created at IBM and successfully used at Motorola, Telcordia, Nortel, and Lucent, among others, utilizes the defect stream from software testing as a source of information on both the software product under development and the software engineering process. Based on this classification and analysis of defects, the overall goal is to improve not only project management, prediction, and quality control by various feedback mechanisms, but also software development processes.
|
From page 47... ...
By using experience factory models in varying areas of application, Basili has discovered that different software development environments have very distinct patterns of clefects. Further, various software engineering techniques have different degrees of effectiveness in remedying various types of error.
|
From page 48... ...
) , reporting on joint work with Bert Steece, Sunita Chulani, and Jongmoon Balk, demonstrated how parametric software estimation models can be used to estimate software CoStS.
|
From page 49... ...
The Bayesian approach provides predictions that approximate collective expert opinions when the experts agree, and that approximate the regression estimates when the data are clean and the experts disagree. The specific form of the Bayesian approach is: p=L 12 XTX+H s [ 1 XTX+Hpo]
|
From page 50... ...
50 INNOVATIONS IN SOFTWARE ENGINEERING demonstrated four applications of such data: estimation of software risk, estimation of the parameters of a fault-tolerant software procedure, creation of a feedback loop to improve the software development process, and estimation of the costs of the development of future systems. These applications provide only a brief illustration of the value of data collected on software functioning.
|
Key Terms
This material may be derived from roughly machine-read images, and so is provided only to facilitate research.
More
information on Chapter Skim is available.