Skip to main content

Currently Skimming:

Reporting
Pages 68-75

The Chapter Skim interface presents what we've algorithmically identified as the most significant single chunk of text within every page in the chapter.
Select key terms on the right to highlight them within pages of the chapter.


From page 68...
... Also, based on the nationally representative sample of students who participated in the national tryout of the test the year before, the percent of students nationally at each achievement level should be provided with the report. This chapter considers the process leading to NAGB's statements to Congress regarding the reporting of VNT results, and it evaluates the stated plarts for reporting results, as outlined in the document submitted to Congress.
From page 69...
... VNT: Proposed Score Reporting Metrics anc3 Examinee Scoring Algorithms for the Voluntary National Tests (American Institutes for Research, 1999r) SCORE COMPUTATION One of the primary recommendations of the NRC's year ~ report was that decisions about how scores will be computed anc3 reported should be macle before the design of the VNT test forms can be fully evaluated (National Research Council, 1999b:51~.
From page 70...
... In VNT: Proposed Score Reporting Metrics anc3 Examinee Scoring Algorithms for the Voluntary National Tests (American Institutes for Research, 1999r) , AIR notes a NAGB decision that "all VNT scoring rubrics for constructed- response items award a score of 'l' only to those responses that are at least partially correct"; in contrast, NAEP awards a score of ~ to attempts at providing relevant responses.
From page 71...
... Confidence bands on this scale should be used to communicate measurement error. As part of the reporting issues focus groups, NAGB asked parents and teachers to react to a sample score report (included as Appendix C in American Institutes for Research, 1999p)
From page 72...
... More rigorous controlled experiments, possibly using cognitive laboratories to test uncler' stancling anc3 use of alternative score reports, for example, might be concluctec3 before decisions about reporting formats are reached.
From page 73...
... Test length considerations make it questionable whether subscores could be sufficiently reliable for incliviclual students. A conceptual problem with subscore reporting is that the NAEP achievement levels are set for each subject as a whole.
From page 74...
... RECOMMENDATION 6.6 NAGB and its contractor should consider including students, particularly at the 8th grade level, as well as parents and teachers in future focus groups on score reporting. AGGREGATION In its report to Congress on the purpose anc3 uses of the VNT, NAGB adopts a stance that discourages but floes not prohibit aggregation of incliviclual student results.
From page 75...
... Incleec3, the VNT is clesignec3 to provide adequate score accuracy for incliviclual students. Most commercial tests encourage aggregation of observed student scores without requiring complex statistic machinery to remove minor biases clue to measurement error.


This material may be derived from roughly machine-read images, and so is provided only to facilitate research.
More information on Chapter Skim is available.