Skip to main content

Evaluation of the Voluntary National Tests Phase 1 (1999) / Chapter Skim
Currently Skimming:

6 Reporting
Pages 48-51

The Chapter Skim interface presents what we've algorithmically identified as the most significant single chunk of text within every page in the chapter.
Select key terms on the right to highlight them within pages of the chapter.


From page 48...
... In this section, we discuss four key issues in reporting VNT results anc3 describe implications of decisions about these issues for other test development activities. KEY ISSUES The charge for phase ~ of our evaluation floes not emphasize evaluation of reporting plans anc3, as inclicatec3 above, final decisions on many reporting issues are not yet available for review.
Read the entire page →
From page 49...
... Furthermore, neither the descriptions of expected student competencies nor the exemplar items appear appropriate for describing actual student performance at the achievement levels defined by the outscores. Evaluators have repeatedly concluded that the knowledge and skills assessed by exemplar items do not match up well with the knowledge and skill expectations put forth in the achievement- level descriptions, nor do the exemplars provide a reasonable view of the range of types of performance expected at a given achievement level.
Read the entire page →
From page 50...
... We believe that students level reporting will drive the need for accuracy in VNT results, but tolerance for different levels of accuracy in aggregate results should be explored before final decisions about test accuracy requirements are reached. The VNT contractors have begun to discuss alternatives for reporting aggregate results, ranging from somewhat complex procedures for aggregating probabilities of being at each level for each student through ways of distancing results from the two programs so that conflicts will not be alarming anc3, perhaps, not even visible.
Read the entire page →
From page 51...
... Other factors, such as item calibration anc3 equating anc3 linking errors, also influence the accuracy of VNT test results. Methods used by NAEP, including conditioning and plausible values, are not appropriate for reporting individual student results and are not needed for VNT.
Read the entire page →

Key Terms

  • aggregate results
  • reporting issues
  • vnt results
  • field test
  • reporting aggregate

  • final decisions
  • achievement level
  • exemplar items
  • national assessment
  • test frameworks

  • test reporting
  • computing aggregate
  • plausible values
  • reporting plans
  • test result

  • reporting individual
  • specific policies
  • somewhat complex
  • accuracy levels
  • actual student

  • schedule called
  • aggregating probabilities
  • particular focus
  • measurement error
  • educational progress

  • vnt contractors
  • test questions
  • measurement errors
  • student proficiency
  • diagnostic information


    • This material may be derived from roughly machine-read images, and so is provided only to facilitate research.
    More information on Chapter Skim is available.