Measuring Literacy Performance Levels for Adults (2005) / Chapter Skim
Currently Skimming:
APPENDIX C: July 2004 Bookmark Standard-Setting Session with the 1992 NALS Data
APPENDIX C: July 2004 Bookmark Standard-Setting Session with the 1992 NALS Data
Pages 221-284
The Chapter Skim interface presents what we've algorithmically identified as the most significant single chunk of text within every page in the chapter.
Select key terms on the right to highlight them within pages of the chapter.
From page 221... ...
Department of Education and its contractors with any follow-up analyses that need to be conducted with respect to the cut scores for the performance levels. BOOKMARK STANDARD SETTING WITH THE 1992 NALS DATA The July 2004 session was held to obtain panelists' judgments about cut scores for the 1992 NALS and to collect their feedback about the performance-level descriptions.
|
From page 222... ...
and the document items second (referred to as Occasion 2 bookmark placements) ; three tables worked with the document items first (Occasion 1)
|
From page 223... ...
Accompanying each ordered item booklet was an item map that listed each item number and a brief description of the item. The number of items in each NALS ordered item booklet was 39 for prose literacy, 71 for document literacy, and 42 for quantitative literacy.
|
From page 224... ...
For Round 3, each table again received a summary of the Round 2 bookmark placements made by each table member as well as the medians for the table. In addition, each table received impact data, that is, the proportion of the 1992 population who would have been categorized at the below basic, basic, intermediate, or advanced literacy level based on the table's median cut points.
|
From page 225... ...
the extent to which panelists understand and can make sense of the concept of response probability level when making judgments about cut scores and (2) the extent to which panelists make different choices when faced with different response probability levels.
|
From page 226... ...
Each table of panelists used the same response probability level for the second content area as they did for the first. Refining the Performance-Level Descriptions The performance-level descriptions used at the July standard setting consisted of overall and subject-specific descriptors for the top four performance levels.
|
From page 227... ...
with the cut scores decided by their table, indicating a high level of participant confidence in both the process and the product of the standard-setting session. In addition, 85 percent (n = 29)
|
From page 228... ...
Prose Literacy A complete listing of all judgments made by each panelist who reviewed the prose literacy scale at the July standard-setting session is presented in Tables C-2A, C-2B, and C-2C respectively, for Basic, Intermediate, and Advanced. The information included in the table consists of each participant's bookmark placement for each round, as well as the corresponding scale score.3 The table number and response probability (rp)
|
From page 229... ...
Across performance levels and rp levels, the standard errors were lowest with the 67 percent response probability level. Document Literacy Panelists at six of the nine tables reviewed NALS items from the document literacy scale.
|
From page 230... ...
Unlike the data for prose literacy, the standard error of the mean for document literacy across rp levels and performance levels was lowest for rp50 and highest for rp80. Quantitative Literacy Panelists at six of the nine tables reviewed NALS items from the quantitative literacy scale.
|
From page 231... ...
associated with the bookmark placement should be identical under the three different response probability instructions, even though the bookmark locations would differ. Given these expectations for panelists' implementation of the response probability criteria, we further examined both the bookmark placements and the resulting scaled cut scores.
|
From page 232... ...
Examination of Bookmark Placements To examine the extent to which panelists adjusted their judgments based on the different response probability instructions, we first examined the bookmark placements. Tables C-8, C-9, and C-10 present the Round 1 median bookmark placements for the different rp values, separated by Occasion 1 and for the two occasions combined.
|
From page 233... ...
If it were the case that the panelists were insensitive to the rp instructions -- making the same bookmark placements on average in all three rp conditions -- a positive relationship between the rp condition and the scaled cut scores would result 4In addition, a follow-up questionnaire asked panelists what adjustments they would have made to their bookmark placements had they been instructed to use different rp criteria. For each of the three rp criteria, panelists were asked if they would have placed their bookmarks earlier or later in the ordered item booklet if they had been assigned to use a different rp instruction.
|
From page 234... ...
Given the strong relationship between the rp condition and the scaled cut scores, however, it is clear that the size of the adjustment made by the panelists falls short of the ideal. As before, a series of follow-up regressions were run, one for each combination of literacy area and performance levels.
|
From page 235... ...
Level, July 2004 264 C-6 Participants' Bookmark Placements and Associated Cut Scores for Quantitative Literacy, July 2004 266 C-7 Summary Statistics for the Round 3 Judgments for Quantitative Literacy by Response Probability (RP) Level, July 2004 272 C-8 Summary of Round 1 Bookmark Placements and Cut Scores for Prose Literacy by Response Probability (RP)
|
From page 236... ...
236 APPENDIX C C-13 Regression Results for Bookmark Placements for Quantitative Literacy, July 2004 278 C-14 Regression Results for Cut Scores for Prose Literacy, July 2004 279 C-15 Regression Results for Cut Scores for Document Literacy, July 2004 280 C-16 Regression Results for Cut Scores for Quantitative Literacy, July 2004 281 Figures C-1 Prose literacy cut scores by round for participants at each table, July 2004 282 C-2 Document literacy cut scores by round for participants at each table, July 2004 283 C-3 Quantitative literacy cut scores by round for participants at each table, July 2004 284
|
From page 237... ...
Participants review all items of NALS (1st subject area) individually 2:004:00 PM Participants at each table, as a group, study and discuss items in the ordered item booklets
|
From page 238... ...
Tables receive data from their Round 1 judgments Bookmark directions given for Round 2 As a group, discussion about Round 1 data Round 2 judgments made individually 9:4510:30 AM Break 10:30 AMNoon Round 3 (2nd subject area) Tables receive impact data from their Round 2 judgments Bookmark directions given for Round 3 As a group, discussion about Round 2 data Round 3 judgments made individually Individually, each panelist suggests edits to performance-level descriptions 1:302:30 PM Round 1 (2nd subject area)
|
From page 239... ...
Tables receive data from their Round 1 judgments Bookmark directions given for Round 2 bookmark placement As a group, discussion about Round 1 data Round 2 judgments made individually 9:4510:30 AM Break 10:30 AMNoon Round 3 (2nd subject area) Tables receive impact data from their Round 2 judgments placement As a group, discussion about Round 2 data Round 3 judgments made individually Individually, each panelist suggests edits to performance-level descriptions Noon1:00 PM Group discussion 1:00 PM Standard setting meeting adjourned 1:001:30 PM Box lunch 1:302:30 PM Large-group discussion on NALS performance-level descriptions
|
From page 240... ...
240 APPENDIX C Professional and Personal Information Questionnaire Bookmark Standard-Setting Session for NALS July 17-19, 2004 National Research Council, Washington, DC Please answer the following questions in order for us to better understand the characteristics of our group of standard-setting participants.
|
From page 241... ...
STANDARD-SETTING SESSION WITH 1992 NALS DATA 241 4. How familiar were you with the National Adult Literacy Survey (a.k.a.
|
From page 242... ...
Next, to establish your Intermediate Literacy performance level: Place your bookmark to identify those items which you believe adults with Intermediate Literacy skills should be able to answer correctly at least 50 percent of the time. Items coming before your bookmark will be answered correctly at least 50 percent of the time by adults in your Intermediate Literacy performance level.
|
From page 243... ...
Next, to establish your Intermediate Literacy performance level: Place your bookmark to identify those items which you believe adults
|
From page 244... ...
Items coming after your book mark may be answered correctly, but they will be answered correctly less than 67 percent of the time by some adults in your Intermediate Literacy performance level. The least literate adult who meets your Intermediate Literacy standard will be able to answer the items just before your book mark with probability just at or above .67 (67 percent)
|
From page 245... ...
Items coming after your book mark may be answered correctly, but they will be answered correctly less than 80 percent of the time by some adults in your Intermediate Literacy performance level. The least literate adult who meets your Intermediate Literacy standard will be able to answer the items just before your book mark with probability just at or above .80 (80 percent)
|
From page 246... ...
246 APPENDIX C Satisfaction Questionnaire Bookmark Standard-Setting Session for the National Adult Literacy Survey (NALS) National Research Council, Washington, DC July 17-19, 2004 Thank you for participating in the standard-setting meeting for the National Adult Literacy Survey (NALS)
|
From page 247... ...
Very Satisfied Satisfied Not Satisfied Please explain: 8. How satisfied were you with the cut scores decided by your table?
|
From page 248... ...
248 APPENDIX C 10. How valuable was your participation in the standard-setting meeting to you?
|
From page 249... ...
249 9 Table Doc. Quant.
|
From page 250... ...
250 2004 SS 226 256 226 226 226 263 250 226 226 197 197 211 197 197 211 July 3 6 6 6 6 8 6 6 5 5 6 5 5 6 Round BK 10 12 Literacy, SS 262 262 226 250 226 262 250 226 224 211 211 225 225 225 211 Prose 2 6 8 6 8 6 5 6 6 7 7 7 6 Basic, Round BK 11 11 11 for c SS 262 276 226 250 226 262 250 226 208 197 197 225 241 242 197 Scores 1 b Cut Round BK 11 14 6 8 6 11 8 6 3 5 5 7 10 11 5 Associated and Occasion 1 1 1 1 2 2 2 2 2 1 1 1 1 1 2 Placements Probability 0.80 0.80 0.80 0.80 0.80 0.80 0.80 0.80 0.80 0.67 0.67 0.67 0.67 0.67 0.67 Bookmark Table 1 1 1 1 2 2 2 2 2 4 4 4 4 4 5 Participants' C-2A a TABLE Response Participant 1.1 1.2 1.3 1.4 2.1 2.2 2.3 2.4 2.5 4.1 4.2 4.3 4.4 4.5 5.1
|
From page 251... ...
Occasion ..., of booklet 1 2.1, bookmark item 0.67 0.67 0.67 0.67 0.50 0.50 0.50 0.50 0.50 0.50 0.50 0.50 0.50 1.1, the Round (i.e. ordered with after table the left in 8.4 each at associated 5 5 5 5 7 7 7 7 8 8 8 8 8 number score item Participant cut participant the the score.
|
From page 252... ...
252 SS 316 314 316 317 289 289 289 289 289 270 300 270 270 270 3 Literacy, Round BK 23 22 23 24 20 20 20 20 20 20 24 20 20 20 Prose SS 316 316 316 316 289 289 289 289 277 300 300 300 300 300 2 Intermediate, Round BK 23 23 23 23 20 20 20 20 15 24 24 24 24 24 for c SS 289 316 316 287 289 289 314 289 277 270 300 270 300 297 Scores 1 b Cut Round BK 20 23 23 18 20 20 22 20 15 20 24 20 24 23 Associated and Occasion 1 1 1 1 2 2 2 2 2 1 1 1 1 1 Placements Probability 0.80 0.80 0.80 0.80 0.80 0.80 0.80 0.80 0.80 0.67 0.67 0.67 0.67 0.67 Bookmark Table 1 1 1 1 2 2 2 2 2 4 4 4 4 4 Participants' C-2B a 2004 TABLE July Response Participant 1.1 1.2 1.3 1.4 2.1 2.2 2.3 2.4 2.5 4.1 4.2 4.3 4.4 4.5
|
From page 253... ...
253 converted 263 263 263 263 300 276 278 276 281 251 233 285 285 bookmark of ment, place 16 16 16 16 24 23 24 23 25 20 15 26 26 explanation bookmark 263 325 263 263 300 276 278 276 281 251 233 285 285 for the 112 pg. 16 29 16 16 24 23 24 23 25 20 15 26 26 before (see item last 260 325 225 270 300 251 278 276 294 251 233 301 276 276 placed the was for 15 29 7 20 24 20 24 23 29 20 15 31 23 23 conflict.
|
From page 254... ...
254 SS 349 362 433 362 333 362 362 333 317 343 343 300 391 359 3 Literacy, Round BK 30 32 39 32 27 32 32 27 24 34 34 24 37 36 Prose SS 371 363 433 371 317 349 362 317 317 407 401 401 424 391 2 Advanced, Round BK 34 33 39 34 24 30 32 24 24 39 38 38 40 37 for c SS 371 363 433 329 317 362 410 324 324 401 343 329 424 359 Scores 1 b Cut Round BK 34 33 39 26 24 32 37 25 25 38 34 30 40 36 Associated and Occasion 1 1 1 1 2 2 2 2 2 1 1 1 1 1 Placements Probability 0.80 0.80 0.80 0.80 0.80 0.80 0.80 0.80 0.80 0.67 0.67 0.67 0.67 0.67 Bookmark Table 1 1 1 1 2 2 2 2 2 4 4 4 4 4 Participants' C-2C a 2004 TABLE July Response Participant 1.1 1.2 1.3 1.4 2.1 2.2 2.3 2.4 2.5 4.1 4.2 4.3 4.4 4.5
|
From page 255... ...
the ordered with after table the left in each 8.4 at associated number 5 5 5 5 5 7 7 7 7 8 8 8 8 8 score item Participant cut participant the the score. data: first scale The Denotes a b c Denotes a 5.1 5.2 5.3 5.4 5.5 7.1 7.2 7.3 7.4 8.1 8.2 8.3 8.4 8.5 Missing placements)
|
From page 256... ...
256 2004 July 4.30 9 0.80 32.00 30.56 32.98 10.99 362.36 357.25 Level, (RP) 3.46 7.17 0.67 33.00 33.00 22.66 10 336.25 341.59 3.68 8 Probability 36.50 35.88 33.73 11.93 Advanced 0.50 351.6 345.76 Response 1.66 4.63 9 0.80 20.00 21.33 13.89 by 289.34 301.03 Prose 3.16 4.52 for 0.67 20.00 19.20 14.28 10 269.52 273.01 3.69 6.61 8 23.50 22.75 18.70 Judgments Intermediate 0.50 277.1 270.88 3 Round 6.00 7.33 2.24 5.18 9 0.80 15.53 226.09 236.24 the for 6.00 5.60 0.52 6.88 2.18 0.67 10 210.58 205.25 Statistics 8.00 8.25 2.49 5.07 Basic 0.50 14.33 205.61 207.21 Summary C-3 Dev.
|
From page 258... ...
258 SS 211 215 211 202 224 224 211 224 185 185 185 185 185 3 Literacy, Round BK 12 14 12 10 18 18 12 18 10 10 10 10 10 SS 211 215 211 202 224 224 211 224 185 185 185 185 185 Document 2 Basic, Round BK 12 14 12 10 18 18 12 18 10 10 10 10 10 for c SS 211 217 211 202 233 224 211 211 185 185 190 185 185 Scores 1 b Cut Round BK 12 15 12 10 21 18 12 12 10 10 13 10 10 Associated and Occasion 2 2 2 2 1 1 1 1 2 2 2 2 2 Placements Probability 0.80 0.80 0.80 0.80 0.80 0.80 0.80 0.80 0.67 0.67 0.67 0.67 0.67 Bookmark Table 1 1 1 1 3 3 3 3 4 4 4 4 4 Participants' C-4A a 2004 TABLE July Response Participant 1.1 1.2 1.3 1.4 3.1 3.2 3.3 3.4 4.1 4.2 4.3 4.4 4.5
|
From page 259... ...
Occasion ..., of 1 booklet 2.1, bookmark item 0.67 0.67 0.67 0.67 0.67 0.50 0.50 0.50 0.50 0.50 0.50 0.50 0.50 0.50 1.1, the Round (i.e. after ordered with table left the in 7.3 each of associated 6 6 6 6 6 7 7 7 7 9 9 9 9 9 number score Participant item cut participant the the score.
|
From page 260... ...
260 Literacy, SS 257 244 257 260 276 267 276 276 247 253 255 247 3 Round BK 40 30 40 42 48 45 48 48 47 49 51 47 Document SS 257 244 257 260 276 275 276 276 247 253 255 247 2 Intermediate, Round BK 40 30 40 42 48 47 48 48 47 49 51 47 for c SS 257 240 257 260 276 261 276 276 247 271 226 226 Scores 1 b Cut Round BK 40 27 40 42 48 43 48 48 47 56 34 34 Associated and Occasion 2 2 2 2 1 1 1 1 2 2 2 2 Placements Probability 0.80 0.80 0.80 0.80 0.80 0.80 0.80 0.80 0.67 0.67 0.67 0.67 Bookmark Table 1 1 1 1 3 3 3 3 4 4 4 4 Participants' C-4B a 2004 TABLE July Response Participant 1.1 1.2 1.3 1.4 3.1 3.2 3.3 3.4 4.1 4.2 4.3 4.4
|
From page 261... ...
Occasion ..., of 1 booklet 2.1, bookmark item 0.67 0.67 0.67 0.67 0.67 0.67 0.50 0.50 0.50 0.50 0.50 0.50 0.50 0.50 0.50 1.1, the Round (i.e. after ordered with table left the in 7.3 each of associated 4 6 6 6 6 6 7 7 7 7 9 9 9 9 9 number score Participant item cut participant the the score.
|
From page 262... ...
262 SS 310 276 310 330 386 330 380 343 324 324 324 296 324 Literacy, 3 Round BK 58 48 58 64 70 64 69 66 69 69 69 65 69 Document SS 310 276 310 330 386 330 380 343 296 324 324 296 324 2 Advanced, Round BK 58 48 58 64 70 64 69 66 65 69 69 65 69 for c SS 310 259 310 330 378 330 388 343 296 324 279 296 284 Scores 1 b Cut Round BK 58 41 58 64 68 64 71 66 65 69 57 65 58 Associated and Occasion 2 2 2 2 1 1 1 1 2 2 2 2 2 Placements Probability 0.80 0.80 0.80 0.80 0.80 0.80 0.80 0.80 0.67 0.67 0.67 0.67 0.67 Bookmark Table 1 1 1 1 3 3 3 3 4 4 4 4 4 Participants' C-4C a 2004 TABLE July Response Participant 1.1 1.2 1.3 1.4 3.1 3.2 3.3 3.4 4.1 4.2 4.3 4.4 4.5
|
From page 263... ...
Occasion ..., of 1 booklet 2.1, bookmark item 0.67 0.67 0.67 0.67 0.67 0.50 0.50 0.50 0.50 0.50 0.50 0.50 0.50 0.50 1.1, the Round (i.e. after ordered with table left the in 7.3 each of associated 6 6 6 6 6 7 7 7 7 9 9 9 9 9 number score Participant item cut participant the the score.
|
From page 264... ...
264 (RP) 0 7.22 8 0.8 32.00 62.13 36.73 12.99 330.00 333.13 Probability 2.63 9.39 0.67 33.00 70.40 29.70 10 343.38 345.05 Response by 1.60 7.53 8 Advanced 0.50 36.50 68.00 21.30 304.89 306.68 Literacy 6.16 4.13 8 0.80 20.00 42.63 11.68 263.50 264.14 Document 3.75 3.25 for 0.67 20.00 51.10 10.27 10 254.96 257.30 4.44 5.10 1.80 8 Judgments Intermediate 0.50 23.50 52.00 232.80 230.16 3 Round 6.00 3.28 8.10 2.86 8 0.80 14.25 213.00 215.25 the for 6.00 3.65 8.54 2.70 0.67 13.30 10 188.96 192.28 Statistics 8.00 1.04 2.55 0.90 Basic 0.50 22.25 190.17 189.49 Summary 2004 C-5 July Dev.
|
From page 266... ...
266 SS 287 287 284 287 283 277 251 277 277 216 217 216 216 211 272 3 Literacy, Round BK 16 16 15 16 14 8 6 8 8 5 6 5 5 4 16 SS 300 300 284 300 283 283 283 277 277 216 217 216 216 211 272 Quantitative 2 Basic, Round BK 18 18 15 18 14 14 14 8 8 5 6 5 5 4 16 for c SS 283 300 282 287 295 277 283 251 277 216 217 216 211 272 Scores 1 b Cut Round BK 14 18 13 16 17 8 14 6 8 5 6 5 1 4 16 Associated and Occasion 1 1 1 1 1 2 2 2 2 1 1 1 1 1 2 Placements Probability 0.80 0.80 0.80 0.80 0.80 0.80 0.80 0.80 0.80 0.67 0.67 0.67 0.67 0.67 0.67 Bookmark Table 2 2 2 2 2 3 3 3 3 5 5 5 5 5 6 Participants' C-6A a 2004 TABLE July Response Participant 2.1 2.2 2.3 2.4 2.5 3.1 3.2 3.3 3.4 5.1 5.2 5.3 5.4 5.5 6.1
|
From page 267... ...
267 1 Round converted 271 271 271 271 235 225 235 225 235 258 258 250 250 lacements) .p after ment, left 15 15 15 15 11 8 11 8 .29 place 11 15 15 14 14 bookmark of 271 271 271 271 235 235 235 225 235 258 258 250 250 Participant bookmark 1)
|
From page 268... ...
268 SS 349 355 349 349 342 326 309 349 287 276 307 272 276 276 307 311 3 Round BK 30 32 30 30 27 22 20 30 16 18 25 17 18 18 25 27 Quantitative SS 369 369 349 369 342 346 346 349 326 276 307 272 276 276 307 311 2 Intermediate, Round BK 36 36 30 36 27 29 29 30 22 18 25 17 18 18 25 27 for c SS 349 369 342 322 355 326 334 349 287 307 271 271 271 276 307 347 Scores 1 b Cut Round BK 30 36 27 21 32 22 26 30 16 25 14 14 14 18 25 37 Associated and Occasion 1 1 1 1 1 2 2 2 2 1 1 1 1 1 2 2 Placements Probability 0.80 0.80 0.80 0.80 0.80 0.80 0.80 0.80 0.80 0.67 0.67 0.67 0.67 0.67 0.67 0.67 Bookmark Table 2 2 2 2 2 3 3 3 3 5 5 5 5 5 6 6 Participants' 2004 July C-6B a TABLE Literacy, Response Participant 2.1 2.2 2.3 2.4 2.5 3.1 3.2 3.3 3.4 5.1 5.2 5.3 5.4 5.5 6.1 6.2
|
From page 269... ...
placement. Occasion ..., booklet of 1 2.1, item bookmark 1.1, 0.67 0.67 0.67 0.50 0.50 0.50 0.50 0.50 0.50 0.50 0.50 0.50 0.50 the Round (i.e., ordered with after table the left in 9.2 each of associated 6 6 6 8 8 8 8 8 9 9 9 9 9 number score item Participant cut participant the the score.
|
From page 270... ...
270 Literacy, SS 389 421 421 389 382 366 349 389 351 347 347 307 347 329 410 3 Round BK 39 41 41 39 38 35 30 39 31 37 37 25 37 32 43 Quantitative SS 389 421 421 389 382 382 366 389 389 347 347 307 347 329 410 2 Advanced, Round BK 39 41 41 39 38 38 35 39 39 37 37 25 37 32 43 for c SS 389 421 436 389 433 389 366 433 351 387 347 307 324 329 410 Scores 1 b Cut Round BK 39 41 43 39 42 39 35 42 31 41 37 25 30 32 43 Associated and Occasion 1 1 1 1 1 2 2 2 2 1 1 1 1 1 2 Placements Probability 0.80 0.80 0.80 0.80 0.80 0.80 0.80 0.80 0.80 0.67 0.67 0.67 0.67 0.67 0.67 Bookmark Table 2 2 2 2 2 3 3 3 3 5 5 5 5 5 6 Participants' C-6C a 2004 TABLE July Response Participant 2.1 2.2 2.3 2.4 2.5 3.1 3.2 3.3 3.4 5.1 5.2 5.3 5.4 5.5 6.1
|
From page 271... ...
placement. Occasion ..., booklet of 1 2.1, item bookmark 1.1, 0.67 0.67 0.67 0.67 0.50 0.50 0.50 0.50 0.50 0.50 0.50 0.50 0.50 0.50 the Round (i.e., ordered with after table the left in 9.2 each of associated 6 6 6 6 8 8 8 8 8 9 9 9 9 9 number score item Participant cut participant the the score.
|
From page 272... ...
272 (RP) 0 4.09 8.78 9 0.8 39.00 37.00 26.33 389.15 384.23 Probability 5.86 0.67 38.00 37.90 39.28 12.42 10 351.40 367.46 Response by 1.88 7.50 9 Advanced 0.50 39.00 39.44 22.51 323.45 339.92 Literacy 5.61 7.70 9 0.80 30.00 26.33 23.10 348.64 334.9 Quantitative 4.25 5.58 for 0.67 25.00 22.60 17.64 10 307.18 295.22 2.32 8.66 2.89 9 Judgments Intermediate 0.50 26.00 27.11 283.52 289.43 3 Round 4.26 3.82 9 0.80 14.00 11.89 11.45 283.36 279.13 the for 5.40 9.33 0.67 10.50 10.10 29.51 10 244.34 243.59 Statistics 2.76 4.28 Basic 0.50 11.00 11.89 12.85 235.05 241.14 Summary 2004 C-7 July Dev.
|
From page 273... ...
273 38.0 36.0 0.50 374.0 333.0 9 Probability 36.0 35.0 0 0.67 359.0 351.0 Response by 33.5 32.0 Advanced 0.80 367.0 362.0 Literacy Prose 23.5 23.0 0.50 277.0 276.0 991 for Scores 23.0 21.5 0 0.67 297.0 283.0 Cut and 21.5 20.0 Intermediate 0.80 302.5 289.0 Placements 10.0 6.0 0.50 217.0 194.0 991 Bookmark 7.0 7.0 1 0.67 225.0 225.0 10 2004 Round July of 9.5 8.0 Basic 0.80 256.0 454454454 250.0 Occasion, 2 Summary score score and and bookmark cut 1 1 bookmark cut C-8 Level placement Level placement Median Median N Median Median N9 TABLE (RP) RP Occasion Occasions
|
From page 274... ...
274 0.50 65.0 279.0 67.0 286.0 9 Response 0.67 73.0 378.0 70.0 0 341.5 by Literacy Advanced 0.80 67.0 360.5 64.0 330.0 Document 46.0 0.50 221.0 5455 46.0 221.0 981 for Scores 0.67 48.0 45.5 10 252.0 244.5 Cut and 45 8 Intermediate 0.80 48.0 42.5 276.0 260.5 Placements 0.50 20.0 182.0 18.0 176.0 9 2004 July Bookmark 1 0.67 15.0 193.0 12.0 188.5 10 Occasion, Round of and 15.0 Basic 0.80 217.5 455 12.0 211.0 Level 2 Summary score (RP) score and bookmark cut 1 1 bookmark cut C-9 Level Median placement Median N Median placement Median N8 TABLE Probability RP Occasion Occasions
|
From page 275... ...
275 0.50 40.0 351.0 39.0 323.0 10 Response by 0.67 32.0 329.0 40.0 0 371.5 Literacy Advanced 0.80 41.0 421.0 39.0 389.0 91 Quantitative 0.50 27.0 288.0 26.5 286.0 10 for Scores 0.67 14.0 271.0 25.0 307.0 10 Cut and Intermediate 0.80 30.0 349.0 27.0 342.0 9 Placements 0.50 11.0 235.0 11.0 0 235.0 2004 July Bookmark 1 5.0 0.67 216.0 10.5 271.0 Round Occasion, of and 19.0 Basic 0.80 287.0 545555555 14.0 283.0 991 Level Summary 2 score (RP) score and bookmark cut 1 1 bookmark cut C-10 Level Median placement Median N Median placement Median N TABLE Probability RP Occasion Occasions
|
From page 276... ...
33.9 (1.66) R2 0.24 0.14 aRegression coefficient.
|
From page 277... ...
67.6 (2.20) R2 0.39 0.15 aRegression coefficient.
|
From page 278... ...
37.6 (1.83) R2 0.46 0.03 aRegression coefficient bStandard error *
|
From page 279... ...
361.00 (15.51) R2 0.01 0.04 aRegression coefficient.
|
From page 280... ...
333.50 (13.33) R2 0.52 0.11 aRegression coefficient.
|
From page 281... ...
369.00 (13.01) R2 0.65 0.40 aRegression coefficient.
|
From page 282... ...
425 375 325 275 225 175 425 375 325 275 225 175 2004. July standalone by table, RP-67 dnu RP-67 dnu 5 each 4 Ro Ro at depicted Table are Table 123 123 participants medians 3 425 375 325 275 225 175 425 375 325 275 225 175 for Round round by RP-80 dnu RP-80 dnu scores judgments.
|
From page 283... ...
425 375 325 275 225 175 425 375 325 275 225 175 2004. July standalone 3 3 by table, RP-67 RP-67 each und und 6 depicted 4 Ro Ro at are Table Table 12 12 participants medians 3 for 425 375 325 275 225 175 425 375 325 275 225 175 Round round 3 3 by RP-80 scores judgments.
|
From page 284... ...
284 () , basic indicate 3 3 Symbols symbols.
|
Key Terms
This material may be derived from roughly machine-read images, and so is provided only to facilitate research.
More
information on Chapter Skim is available.