Skip to main content

Designing a Market Basket for NAEP Summary of a Workshop (2000) / Chapter Skim
Currently Skimming:

8 Summing Up: Issues to Consider and Address
Pages 51-57

The Chapter Skim interface presents what we've algorithmically identified as the most significant single chunk of text within every page in the chapter.
Select key terms on the right to highlight them within pages of the chapter.


From page 51...
... the use of percentcorrect scores as the summary indicator to communicate performance on the set of released items; and (4) the use of a short form to enable comparisons of performance on state and local tests with performance on NAEP.
Read the entire page →
From page 52...
... First, the CPI market basket was conceived as a purely descriptive measure and is built using extensive data on actual consumer purchases. In contrast, the NAEP market basket would not passively measure what is actually being learned by school students.
Read the entire page →
From page 53...
... RELEASING A LARGE REPRESENTATIVE SET OF ITEMS Many workshop participants commented on the utility of public release of a large representative set of NAEP items. They thought that such a release could potentially impact education reform by allowing teachers, administrators, curriculum specialists, and assessment directors to use the items in discussions about their instructional practices, curricular changes, and state and local assessments.
Read the entire page →
From page 54...
... LINKING SHORT FORM RESULTS TO NAEP AND TO STATE AND LOCAL ASSESSMENTS The most common use cited for the short form was embedding it into state and local assessments, thus providing states and localities with a "link" to NAEP. A previous NRC committee studied this subject in depth by examining several scenarios for embedding, including the embedding of representative blocks of NAEP material (National Research Council, 1 999a)
Read the entire page →
From page 55...
... Costs NAEP has invested a considerable amount of time and money in the development of two short forms. Future work will be needed to score the short forms, to devise a mechanism for comparing percent correct scores with main NAEP scores, and to develop reporting procedures.
Read the entire page →
From page 56...
... A single student takes three blocks of items. This sort of test assembly is very different from that typically used in tests developed for educational purposes, where a test form that has the proper mix of content and item type to represent the test specifications is the end result, and a given student takes the entire test.
Read the entire page →
From page 57...
... According to Thissen, NAEP's current procedures treat testing as measurement, seeking to obtain the most accurate estimates of student performance. Implementation of procedures that involve the short form will move NAEP into the category of testing as a contest.
Read the entire page →

Key Terms

  • percent correct
  • naep market
  • short form
  • short forms
  • correct scores

  • local assessments
  • cpi market
  • representative set
  • education reform
  • substantial differences

  • stated goals
  • naep scores
  • john mazzeo
  • test specifications
  • latent trait

  • naep material
  • instructional practices
  • local results
  • facilitate reporting
  • cpi involves

  • derived scores
  • reflect regional
  • test assembly
  • assessment directors
  • form proceeds

  • currently reports
  • regarding implementation
  • embedded material
  • forms proceed
  • considerable amount


    • This material may be derived from roughly machine-read images, and so is provided only to facilitate research.
    More information on Chapter Skim is available.