Testing Teacher Candidates The Role of Licensure Tests in Improving Teacher Quality (2001) / Chapter Skim
Currently Skimming:
Test 1: Pre-Professional Skills Test - Reading Test
Test 1: Pre-Professional Skills Test - Reading Test
Pages 351-370
The Chapter Skim interface presents what we've algorithmically identified as the most significant single chunk of text within every page in the chapter.
Select key terms on the right to highlight them within pages of the chapter.
From page 351... ...
The test is a 40-item multiple-choice test designed to be administered in a one-hour period. In some states the test is administered prior to admission to a teacher preparation program; in other states it may be administered at any time prior to obtaining an initial teaching certificate (license)
|
From page 352... ...
These 119 initial enabling skills were then reviewed by an external review panel of 21 practicing professionals (working teachers, principals, deans/associate deans of education, state directors of teacher education and certification, and state representatives of the National Parent-Teacher Association) who were nominated by appropriate national organizations.
|
From page 353... ...
. A 1991 ETS report entitled Identification of a Core of Important Enabling Skills for the NTE Successor Stage I Examination describes the job analysis in detail.
|
From page 354... ...
: ETS has provided only a generic description of the test development procedures for its licensure tests. In addition to the generic description, ETS has developed its own standards (The ETS Standards for Quality and Fairness, November 1999)
|
From page 355... ...
. The ETS Fairness Review Panel subsequently reviewed flagged items for lack of fairness.
|
From page 356... ...
(The 1993 data are contained in the January 2000 ETS report Test Analysis Pre-Professional Skills Test Form 3PPS1, and summary comparative data for the 1993 and 1997 test are in a single-page document, Comparative Summary Statistics for PPST Reading t0710~.) Comment: The score reliabilities are marginally adequate for the purpose of the test, especially given the length of the test (40 items)
|
From page 357... ...
There were 23 common items (out of 40~. (The 1993 data and equating information are contained in the January 2000 ETS report, Test Analysis Pre-Professional Skills Test Form 3PPS14.
|
From page 358... ...
: ETS's January 2000 Test Analysis Pre-Professional Skills Test Form 3PPS1 report includes summary data on the October 1993 administration of Form 3PPS1. These data include information on test takers' speed (99.7 percent of examiners reached item 40)
|
From page 359... ...
studies: DIF is performed using the Mantel-Haenszel index expressed on the delta scale. DIF analyses are performed to compare item functioning for two mutually exclusive groups whenever there are sufficient numbers of examiners to justify using the procedure (N 2 200~.
|
From page 360... ...
(Recall that one of the questions external reviewers answered in the discussion of the match of the items to the test specifications was a fairness question.) This summary was developed from Overview: ETS Fairness Review.
|
From page 361... ...
If ETS uses the procedure described for setting a recommended cut score in each of the states that use this test, the process reflects what is considered by most experts in standard setting to be sound measurement practice. There is some controversy in the use of the Angoff method, but it remains the most often used method for setting cut scores for multiple-choice licensure examinations.
|
From page 362... ...
In some cases both validity and standard-setting studies may be conducted concurrently by the same panels. Comment: The procedures described by ETS for collecting content validity evidence are consistent with sound measurement practice.
|
From page 363... ...
forms were equated using the Tucker equating method and a set of 23 common items. Weights for converting raw scores to scale scores equated to the base form are provided in a statistical report (ETS, January 2000, Test Analysis Pre-Professional Skills Test Form 3PPS1~.
|
From page 364... ...
Moreover, there is no indication that operational test forms include nonscored items (a method for pilot testing items under operational conditions)
|
From page 365... ...
is not a likely problem. Other than the materials that describe the test development process, no materials were provided that specifically examined the potential for contamination of test scores.
|
From page 366... ...
The large number of administration sites suggests that there will be some variability in the appropriateness of accommodations; however, it is clear that efforts are made (providing detailed manuals, announced and unannounced site visits by ETS staff) to ensure at least a minimum level of appropriateness.
|
From page 367... ...
The base costs to examiners in the 19992000 year (through June 2000) were a $35 nonrefundable registration fee and a fee of $18 for the Reading test Under certain conditions additional fees may be assessed (e.g., $35 for a late registration fee; $35 for a change in test, test center, or date)
|
From page 368... ...
Comment: The level of detail in the administration manuals is appropriate and consistent with sound measurement practice. It is also consistent with sound practice that ETS representatives periodically observe the administration (either announced or unannounced)
|
From page 369... ...
related to such things as descriptions of the program, the need for using justifiable procedures in setting passing scores, history of past litigation related to testing, and the need for validity for licensure tests. Comment: The materials available to applicants are substantial and would be helpful.
|
From page 370... ...
The procedures used for test development, standard setting, and validation are all consistent with sound measurement practices. The fairness reviews and technical strategies used also are consistent with sound measurement practices.
|
Key Terms
This material may be derived from roughly machine-read images, and so is provided only to facilitate research.
More
information on Chapter Skim is available.