Skip to main content

Currently Skimming:

8 Analysis and Reporting
Pages 75-78

The Chapter Skim interface presents what we've algorithmically identified as the most significant single chunk of text within every page in the chapter.
Select key terms on the right to highlight them within pages of the chapter.


From page 75...
... NCES response to Q33 says that the design, analysis, and re porting contract includes the following activities: "designs all pilot and field tests, operational assessments, and special studies; analyzes data ensuring reporting of valid results; proposes and prepares psychometric and statistical analyses compatible with previous NAEP methodologies; specifies data needed to meet the goals for reporting; and prepares reports." 2 NCES response to Q32.
From page 76...
... On the analysis side, complex analyses that were previously specially programmed are now largely automated. This includes, for example, the analyses carried out to understand the performance of items and to populate the standardized "report card" reports.5 In addition, NAEP pioneered the provision of customized online analyses, with the NAEP Data Explorer, though the platform limits data elements and visualizations, which reduces its potential use for educational research.6 Another innovative aspect of data analyses concerns the use of process data, based on the data stream created by student interactions with computer-based testing.
From page 77...
... Recently, NAEP has used standardization and is considering potential use of artificial intelligence to speed the release of the initial "report card" reports for assessments, as well as shortening the time for making data available from 1 year to 6 months.7 Reports that analyze relationships between NAEP data and other variables are consistently among the most popular reports produced by NAEP.8 However, there are relatively few such reports, in large part because NAEP's mission does not explicitly focus on producing such analytical reports to inform policy in the way that the Organisation for Economic Co-operation and Development and some other agencies do.9 This constraint underlines the importance to NAEP's mission of making its data available to others and ensuring that those data provide support for the kinds of analyses that would be useful for policy, particularly with respect to inequities across groups. Thinking broadly, there are at least three ways that the availability of NAEP data could be improved: 1.
From page 78...
... RECOMMENDATION 8-1: The National Center for Education Sta tistics should devote a greater percentage of its budget for innovative analysis and reporting that will increase the use and understanding of NAEP's data, including finding ways to make the raw data available more quickly to researchers, improving the usability and sophistication of the NAEP Data Explorer, making process data more easily acces sible, and expanding the availability and use of important contextual variables.


This material may be derived from roughly machine-read images, and so is provided only to facilitate research.
More information on Chapter Skim is available.