Best Practices in Assessment of Research and Development Organizations (2012) / Chapter Skim
Currently Skimming:
2 Framework for Examination of Assessment Processes
2 Framework for Examination of Assessment Processes
Pages 15-22
The Chapter Skim interface presents what we've algorithmically identified as the most significant single chunk of text within every page in the chapter.
Select key terms on the right to highlight them within pages of the chapter.
From page 15... ...
Effective assessments will also reflect cognizance of the time horizon identified for the various characteristics being evaluated. Metrics and quantitative analyses can be valuable tools in assessments of the technical quality and preparedness of an organization, whereas qualitative findings, informed by quantitative metrics, are more valuable for organizational decision makers.3 Elements of an R&D Organization The context of an assessment includes an articulation of the following elements of the organization: vision, mission, strategic plan, operations plan, and resources.
|
From page 16... ...
Appendix B presents a summary of the presentation by Dr. John Sommerer, Head, Space Sector, and Johns Hopkins University Gilman Scholar, Johns Hopkins University Applied Physics Laboratory, delivered March 19, 2012, at the National Research Council's Workshop on Best Practices in Assessment of Research and Development organizations.4 The presentation highlighted the importance of alignment between an organization's vision and its people, especially in an R&D laboratory.
|
From page 17... ...
The R&D performed in these different sectors may be done for quite different reasons, and assessment criteria may be different for these four settings. The stages of R&D may be characterized as basic research, applied research, advanced technology development, preproduction, and, at times, production and product fielding.
|
From page 18... ...
Applied activities are presented above the timescale, and basic activities are presented below the timescale. At different times during the R&D process, different assessment methods and measures may be applied.
|
From page 19... ...
impact of the R&D and its products. Figure 2-2 illustrates sample assessment indicators for interactions between technical quality and management (referred to as "preparedness" in Figure 2-2 based on the management function of keeping the organization prepared to respond to changing demands)
|
From page 20... ...
Metrics, outputs, and outcomes included in the figure are illustrative, not intended as an exhaustive set; (b) the time frames identified for outputs and outcomes are approximate.
|
From page 21... ...
In the planning stage, prior to the initiation of research, an organization develops goals, selects strategies and tactics intended to reach those goals, identifies personnel and/or workforce development pathways, and lists metrics for evaluating progress. Planning is done in the context of the organization's mission and may entail everything from broad capability development to specific, targeted development efforts.
|
From page 22... ...
Attributes of effective organizations are also proposed in a National Research Council report assessing Department of Defense basic research,7 the NIST Baldridge criteria for performance excellence,8 and reports by Jordan and Binkley that suggest numerous attributes of effective R&D organizations.9,10 SUMMARY OF ASSESSMENT FRAMEWORK CONSIDERATIONS An effective assessment will include an evaluation of an organization's management, the quality of its research and development activities, the impact of the effort, and associated interrelationships. Both qualitative and quantitative measures are required to assess management, quality, and impact.
|
Key Terms
This material may be derived from roughly machine-read images, and so is provided only to facilitate research.
More
information on Chapter Skim is available.