Skip to main content

Currently Skimming:

APPENDIX D: September 2004 Bookmark Standard-Setting Session with the 2003 NAAL Data
Pages 285-326

The Chapter Skim interface presents what we've algorithmically identified as the most significant single chunk of text within every page in the chapter.
Select key terms on the right to highlight them within pages of the chapter.


From page 285...
... Appendix D September 2004 Bookmark Standard-Setting Session with the 2003 NAAL Data T his appendix details how the bookmark procedure was implemented and reports results for the committee's September session. Follow ing the text are the background materials, which include the agenda, participant questionnaires, tables, and figures for the September session.
From page 286...
... 286 APPENDIX D setting. In addition, participants responded that their work environments were predominantly urban (48.1 percent, n = 13)
From page 287...
... STANDARD-SETTING SESSION WITH 2003 NAAL DATA 287 majority of materials presented to the September panelists during the threehour training session were the same as those presented in July, and most of the procedures were the same. Conducting the Standard Setting The procedures used in September were similar to those used in July, with the exception that the committee decided that all panelists in September should use the instructions for a response probability of 67 percent.
From page 288...
... . Revising the Performance-Level Descriptions At the conclusion of the September standard setting, 12 of the panelists were asked to stay for an extended session to write performance-level descriptions for the NAAL items.
From page 289...
... STANDARD-SETTING SESSION WITH 2003 NAAL DATA 289 precluded having panelists from different tables join each other during Round 3. Because all panelists in September used the same rp level, those working on the same literacy area at two different tables were able to merge into one table for the Round 3 discussion, a practice advocated by the developers of the bookmark procedure (Mitzel et al., 2001)
From page 290...
... 290 APPENDIX D Document A complete listing of all judgments made by each panelist who reviewed the document literacy scale at the September standard setting session is presented in Tables D-4. Figure D-2 portrays the cut scores associated with panelists' bookmark placements for each of the three rounds.
From page 291...
... STANDARD-SETTING SESSION WITH 2003 NAAL DATA 291 correlations among the Round 3 scaled cut scores for each literacy area. These intraclass correlations appear below.
From page 292...
... 292 APPENDIX D All of the analyses of 2003 test takers (e.g., the population percentages at each performance level, the median literacy scores derived for the quasicontrasting group procedure) were based on the file delivered to us on January 21, 2005.
From page 293...
... STANDARD-SETTING SESSION WITH 2003 NAAL DATA 293 Fran Holthaus, Upper Valley Joint Vocational School, Piqua, Ohio Sally House, Central Mississippi Correctional Facility, Pearl Brenda Jeans, Beauregard Parish School Board, Louisiana Paul Jurmo, New York University Judy Kihslinger, Waukesha County Technical College, Wisconsin Terry Kinzel, Big Bend Community College, Washington Jaqueline Korengel, Commonwealth of Kentucky, Frankfort Nathan Kuncel, University of Illinois at Urbana-Champaign Diane Lindahl, Western Wisconsin Technical College Ardith Loustalet, St. Vrain Valley School District, Colorado Alfredo Lujan, Monte del Sol Charter School, New Mexico Sanford Marks, Community College of Southern Nevada Peggy McGuire, University of Tennessee Maureen Meehan, University of Illinois at Chicago Doug Molitor, 3M, St.
From page 294...
... 294 APPENDIX D BACKGROUND MATERIALS September Standard-Setting Session Item Page Agenda 296 Professional and Personal Information Questionnaire 299 Tables D-1 Design of the Bookmark Standard Setting with NAAL Data, September 2004 301 D-2 Participants' Bookmark Placements and Associated Cut Scores for Prose Literacy, September 2004 302 D-3 Summary Statistics for Round 3 Cut Scores for Prose Literacy Scale, July and September 2004 305 D-4 Participants' Bookmark Placements and Associated Cut Scores for Document Literacy, September 2004 306 D-5 Summary Statistics for Round 3 Cut Scores for Document Literacy Scale, July and September 2004 309 D-6 Participants' Bookmark Placements and Associated Cut Scores for Quantitative Literacy, September 2004 310 D-7 Summary Statistics for Round 3 Cut Scores for Quantitative Literacy scale, July and September 2004 313 D-8 Item ID Table for Prose Literacy Bookmark Placements, Round 3, July 2004 314 D-9 Item ID Table for Document Literacy Bookmark Placements, Round 3, July 2004 314 D-10 Item ID Table for Quantitative Literacy Bookmark Placements, Round 3, July 2004 316 D-11 Item ID Table for Prose Literacy Bookmark Placements, Round 3, September 2004 318 D-12 Item ID Table for Document Literacy Bookmark Placements, Round 3, September 2004 320 D-13 Item ID Table for Quantitative Literacy Bookmark Placements, Round 3, September 2004 322
From page 295...
... STANDARD-SETTING SESSION WITH 2003 NAAL DATA 295 Figures D-1 Prose literacy cut scores by round for participants at each table, September 2004 324 D-2 Document literacy cut scores by round for participants at each table, September 2004 325 D-3 Quantitative literacy cut scores by round for participants at each table, September 2004 326
From page 296...
... 296 APPENDIX D Agenda Standard-Setting Session for the National Assessment of Adult Literacy (NAAL) National Research Council, Washington, DC September 17-20, 2004 Friday, September 17, 2004 -- The Day Before the Standard Setting 3:00­3:15 PM Welcome, Introductions Stuart Elliott, Judy Koenig, NRC Rich Patz, Consultant to NRC 3:15­5:00 PM Training for Table Leaders Saturday, September 18, 2004 -- Day 1 of Standard Setting 8:00­8:30 AM Participant registration Continental breakfast 8:30­9:00 AM Welcome, Introductions Stuart Elliott, Judy Koenig, NRC Rich Patz, Consultant to NRC 9:00­10:20 AM Training 10:20­10:30 AM Break 10:30 AM­Noon Training continued Noon­1:00 PM Lunch 1:00­2:00 PM Round 1 (1st subject area)
From page 297...
... Tables receive impact data from their Round 2 judgments Bookmark directions given for Round 3 Both tables, as a group, discussion about Round 2 data Round 3 judgments made individually Noon­1:00 PM Lunch 1:00­1:30 PM Large-group meeting 1:30­2:30 PM Round 1 (2nd subject area) Participants review all items of NAAL (2nd subject area)
From page 298...
... Tables receive impact data from their Round 2 judgments Bookmark directions given for Round 3 Both tables, as a group, discussion about Round 2 data Round 3 judgments made individually 11:30 AM­Noon Large-group discussion Noon Standard setting meeting adjourned 12:00­12:30 PM Box Lunch 12:30­3:30 PM Extended session on writing Performance-level descriptions
From page 299...
... STANDARD-SETTING SESSION WITH 2003 NAAL DATA 299 Professional and Personal Information Questionnaire Bookmark Standard-Setting Session for NAAL September 18-20, 2004 National Research Council, Washington, DC Please answer the following questions so we better understand the characteristics of our group of standard setting participants.
From page 300...
... 300 APPENDIX D 4. Standard-setting judgments require one to understand: (A)
From page 301...
... STANDARD-SETTING SESSION WITH 2003 NAAL DATA 301 TABLE D-1 Design of the Bookmark Standard Setting with NAAL Data, September 2004a Table 1 Table 2 Table 3 Table 4 Table 5 Table 6 First Literacy Area: Prose Prose Doc.
From page 302...
... 302 converted SS 206 206 217 206 206 217 210 210 217 206 221 221 229 221 225 233 221 233 233 233 bookmark September 3 of ment, 8 8 8 8 8 place Round BK 12 12 11 11 12 13 13 15 13 14 18 13 18 18 18 Literacy, explanation SS 206 206 206 206 206 210 210 210 217 217 221 221 225 221 225 233 233 233 232 233 bookmark for Prose 2 the 112 pg. Basic, Round BK 8 8 8 8 8 11 11 11 12 12 13 13 14 13 14 18 18 18 17 18 before (see for item c last SS 206 206 229 199 206 210 210 210 217 225 225 229 233 210 225 232 225 233 225 233 placed Scores 1 the was for b Cut Round BK 8 8 15 6 8 11 11 11 12 14 14 15 18 11 14 17 14 18 14 18 location bookmark RP leader.
From page 303...
... 303 converted SS 270 260 270 270 245 249 270 265 249 270 293 293 293 293 293 292 293 292 293 293 lacements) .p 3 ment, Literacy, place Round BK 37 31 37 37 27 29 37 32 29 37 45 45 45 45 45 44 45 44 45 45 bookmark Prose of SS 260 245 251 260 245 249 270 249 249 270 293 293 293 293 293 292 292 292 293 293 bookmark 2 the explanation for Intermediate, Round BK 31 27 30 31 27 29 37 29 29 37 45 45 45 45 45 44 44 44 45 45 before 112 for item pg.
From page 304...
... 304 converted SS 345 368 336 345 345 307 345 332 336 368 345 345 345 345 345 420 420 420 420 420 lacements) .p 3 ment, Literacy, place Round BK 56 60 55 56 56 48 56 53 55 60 56 56 56 56 56 65 65 65 65 65 bookmark of Prose SS 345 368 314 345 368 307 332 307 293 314 307 332 307 293 314 420 420 420 420 420 bookmark 2 the explanation for Advanced, Round BK 56 60 51 56 60 48 53 48 45 51 48 53 48 45 51 65 65 65 65 65 before 112 for item pg.
From page 305...
... 305 2004 8.07 0 Advanced 36.10 345.00 362.60 September and (RP67)
From page 306...
... 306 converted SS 194 198 204 210 194 210 210 210 215 210 210 215 210 192 215 170 170 215 215 215 bookmark 3 of ment, Literacy, Round BK 12 13 17 18 12 18 18 18 19 18 18 19 18 10 19 5 5 place 19 19 19 explanation SS 194 198 204 194 210 210 204 210 210 204 215 215 215 192 215 170 170 215 215 215 bookmark for Document 2 the 112 pg. Basic, Round BK 12 13 17 12 18 18 17 18 18 17 19 19 19 10 19 5 5 19 19 19 before (see for item c last SS 194 192 223 210 193 215 182 210 201 204 215 215 210 192 215 210 170 215 215 215 placed Scores 1 the was for b Cut Round BK 12 10 23 18 11 20 8 18 15 17 19 19 18 10 19 18 5 19 19 19 location bookmark RP leader.
From page 307...
... 307 converted Literacy, SS 243 243 254 256 243 254 254 266 256 243 260 256 260 260 260 235 254 243 254 254 bookmark 3 of ment, place Round BK 36 36 38 40 36 38 38 42 40 36 41 39 41 41 41 29 38 36 38 38 Document explanation SS 243 243 266 243 243 235 236 235 235 236 260 260 260 260 260 235 236 254 254 254 bookmark for 2 the 112 pg. Intermediate, Round BK 36 36 42 36 36 29 32 29 30 31 41 41 41 41 41 29 32 38 38 38 before (see for item c last SS 243 243 280 256 235 236 216 266 224 236 243 274 266 243 243 235 236 256 254 243 placed Scores 1 the was for b Cut Round BK 36 36 50 40 29 31 22 42 25 31 36 48 42 36 36 29 31 40 38 36 location bookmark RP leader.
From page 308...
... 308 converted SS 318 318 371 283 318 332 358 302 332 332 371 371 371 371 371 274 371 371 332 371 bookmark Literacy, 3 of ment, place Round BK 57 57 62 52 57 59 61 56 59 59 62 62 62 62 62 48 62 62 59 62 Document explanation SS 283 318 318 283 318 332 332 302 332 332 371 371 371 371 371 260 371 371 332 358 bookmark for 2 the 112 pg. Advanced, Round BK 52 57 57 52 57 59 59 56 59 59 62 62 62 62 62 41 62 62 59 61 before (see for item c last SS 371 318 318 283 256 301 358 302 266 285 386 386 358 371 332 260 371 371 332 332 placed Scores 1 the was for b Cut Round BK 62 57 57 52 40 55 61 56 42 53 63 63 61 62 59 41 62 62 59 59 location bookmark RP leader.
From page 309...
... 309 2004 7.19 0 Advanced 32.17 345.00 341.90 September and July (RP67)
From page 310...
... 310 converted SS 230 245 230 250 245 245 245 245 245 245 244 244 244 244 266 211 203 244 240 242 lacements) .p 3 ment, Literacy, 5 4 place Round BK 10 16 10 17 16 16 16 16 16 16 15 15 15 15 23 15 12 14 bookmark of SS 215 230 230 250 230 245 245 245 245 252 244 266 244 250 266 211 226 244 242 244 bookmark Quantitative 2 the explanation 6 5 9 for Basic, Round BK 10 10 17 10 16 16 16 16 18 15 23 15 17 23 15 14 15 before 112 for item pg.
From page 311...
... 311 converted SS 289 298 288 298 298 288 289 298 288 295 312 312 302 302 324 267 240 295 288 290 lacements) .p 3 ment, place Round BK 30 35 29 35 35 29 30 35 29 32 41 41 37 37 43 24 12 32 29 31 bookmark Quantitative of SS 288 288 288 298 288 289 304 298 298 298 324 324 312 302 324 267 266 295 290 295 bookmark 2 the explanation for Intermediate, Round BK 29 29 29 35 29 30 38 35 35 35 43 43 41 37 43 24 23 33 31 33 before 112 for item pg.
From page 312...
... 312 converted Literacy, SS 319 356 356 356 356 338 343 356 331 343 461 461 461 393 400 356 369 356 343 331 lacements) .p 3 ment, place Round BK 42 49 49 49 49 46 47 49 45 47 54 54 54 51 53 49 50 49 47 45 bookmark of Quantitative SS 298 356 356 356 356 338 343 356 331 338 461 461 461 461 461 356 369 393 393 393 bookmark 2 the explanation for Advanced, Round BK 35 49 49 49 49 46 47 49 45 46 54 54 54 54 54 49 50 51 51 51 before 112 for item pg.
From page 313...
... 313 2004 9.80 0 September Advanced 43.82 356.00 369.25 and July (RP67) Scale, 3.83 02 Sept.
From page 314...
... 314 APPENDIX D TABLE D-8 Item ID Table for Prose Literacy Bookmark Placements, Round 3, July 2004 Response Participanta Table Probability Occasion 4.1 4 0.67 1 4.2 4 0.67 1 4.3 4 0.67 1 4.4 4 0.67 1 4.5 4 0.67 1 5.1 5 0.67 2 5.2 5 0.67 2 5.3 5 0.67 2 5.4 5 0.67 2 5.5 5 0.67 2 aThe first participant of each table (i.e.
From page 315...
... STANDARD-SETTING SESSION WITH 2003 NAAL DATA 315 Basic Intermediate Advanced Item Round 3 Item Round 3 Item Round 3 Identification BKb SSc Identification BK SS Identification BK SS N080101 5 197 AB60601 20 270 N130301 34 343 N080101 5 197 AB40901 24 300 N130301 34 343 N100101 6 211 AB60601 20 270 AB40901 24 300 N080101 5 197 AB60601 20 270 N120501 37 391 N080101 5 197 AB60601 20 270 N110601 36 359 N100101 6 211 AB60201 16 263 N090801 33 336 N100101 6 211 AB60201 16 263 N090801 33 336 N100101 6 211 AB60201 16 263 N090801 33 336 N100101 6 211 AB60201 16 263 N090801 33 336 N100101 6 211 AB40901 24 300 N090801 33 336 Basic Intermediate Advanced Item Round 3 Item Round 3 Item Round 3 Identification BKb SSc Identification BK SS Identification BK SS N120601 10 185 AB50901 47 247 N010901 69 324 N120601 10 185 N090501 49 253 N010901 69 324 N120601 10 185 AB70701 51 255 N010901 69 324 N120601 10 185 AB50901 47 247 AB60502 65 296 N120601 10 185 AB50901 47 247 N010901 69 324 AB31301 17 202 AB31001 56 271 N/Ad 378 AB31301 17 202 AB31001 56 271 N/A 378 AB50801 15 193 AB70701 51 255 N100701 72 363 AB40101 19 206 AB31001 56 271 N100701 72 363 AB50801 15 193 AB70701 51 255 N/A 378 d Some panelists placed their bookmarks for the advanced level after the final item in the booklet. When this occurred, SS is the scale score associated with the RP location for the final item in the booklet.
From page 316...
... 316 APPENDIX D TABLE D-10 Item ID Table for Quantitative Literacy Bookmark Placements, Round 3, July 2004 Response Participanta Table Probability Occasion 5.1 5 0.67 1 5.2 5 0.67 1 5.3 5 0.67 1 5.4 5 0.67 1 5.5 5 0.67 1 6.1 6 0.67 2 6.2 6 0.67 2 6.3 6 0.67 2 6.4 6 0.67 2 6.5 6 0.67 2 aThe first participant of each table (i.e.
From page 317...
... STANDARD-SETTING SESSION WITH 2003 NAAL DATA 317 Basic Intermediate Advanced Item Round 3 Item Round 3 Item Round 3 Identification BKb SSc Identification BK SS Identification BK SS N100801 5 216 N130601 18 276 N080901 37 347 AB50404 6 217 N011101 25 307 N080901 37 347 N100801 5 216 N110801 17 272 N011101 25 307 N100801 5 216 N130601 18 276 N080901 37 347 LC00601 4 211 N130601 18 276 N010601 32 329 AB40704 16 272 N011101 25 307 N/Ad 410 AB40601 15 271 N081001 27 311 N/A 410 AB40601 15 271 N011101 25 307 N121101 39 356 AB40601 15 271 N081001 27 311 N/A 410 AB40601 15 271 N121001 26 309 N/A 410
From page 318...
... 318 APPENDIX D TABLE D-11 Item ID Table for Prose Literacy Bookmark Placements, Round 3, September 2004 Response Participanta Table Probability Occasion 1.1 1 0.67 1 1.2 1 0.67 1 1.3 1 0.67 1 1.4 1 0.67 1 1.5 1 0.67 1 2.1 2 0.67 1 2.2 2 0.67 1 2.3 2 0.67 1 2.4 2 0.67 1 2.5 2 0.67 1 4.1 4 0.67 2 4.2 4 0.67 2 4.3 4 0.67 2 4.4 4 0.67 2 4.5 4 0.67 2 5.1 5 0.67 2 5.2 5 0.67 2 5.3 5 0.67 2 5.4 5 0.67 2 5.5 5 0.67 2 aThe first participant of each table (i.e.
From page 319...
... STANDARD-SETTING SESSION WITH 2003 NAAL DATA 319 Basic Intermediate Advanced Item Round 3 Item Round 3 Item Round 3 Identification BKb SSc Identification BK SS Identification BK SS C061001 8 206 C080301 37 270 N130301 56 345 C061001 8 206 C071101 31 260 N110601 60 368 N100101 12 217 C080301 37 270 N090801 55 336 C061001 8 206 C080301 37 270 N130301 56 345 C061001 8 206 C020501 27 245 N130301 56 345 N100101 12 217 C040301 29 249 C080701 48 307 C050801 11 210 C080301 37 270 N130301 56 345 C050801 11 210 N120401 32 265 C080701 53 332 N100101 12 217 C040301 29 249 N090801 55 336 C061001 8 206 C080301 37 270 N110601 60 368 C020901 13 221 N130301 45 293 N130301 56 345 C020901 13 221 N130301 45 293 N130301 56 345 C080401 15 229 N130301 45 293 N130301 56 345 C020901 13 221 N130301 45 293 N130301 56 345 C040101 14 225 N130301 45 293 N130301 56 345 C020401 18 233 N120301 44 292 N/Ad 420 C020901 13 221 N130301 45 293 N/A 420 C020401 18 233 N120301 44 292 N/A 420 C020401 18 233 N130301 45 293 N/A 420 C020401 18 233 N130301 45 293 N/A 420
From page 320...
... 320 APPENDIX D TABLE D-12 Item ID Table for Document Literacy Bookmark Placements, Round 3, September 2004 Response Participanta Table Probability Occasion 1.1 1 0.67 2 1.2 1 0.67 2 1.3 1 0.67 2 1.4 1 0.67 2 1.5 1 0.67 2 3.1 3 0.67 1 3.2 3 0.67 1 3.3 3 0.67 1 3.4 3 0.67 1 3.5 3 0.67 1 4.1 4 0.67 1 4.2 4 0.67 1 4.3 4 0.67 1 4.4 4 0.67 1 4.5 4 0.67 1 6.1 6 0.67 2 6.2 6 0.67 2 6.3 6 0.67 2 6.4 6 0.67 2 6.5 6 0.67 2 aThe first participant of each table (i.e.
From page 321...
... STANDARD-SETTING SESSION WITH 2003 NAAL DATA 321 Basic Intermediate Advanced Item Round 3 Item Round 3 Item Round 3 Identification BKb SSc Identification BK SS Identification BK SS C030701 12 194 C030601 36 243 C021101 57 318 C030702 13 198 C030601 36 243 C021101 57 318 C080501 17 204 N090501 38 254 N100701 62 371 C030708 18 210 C080201 40 256 C020201 52 283 C030701 12 194 C030601 36 243 C021101 57 318 C030708 18 210 N090501 38 254 N010901 59 332 C030708 18 210 N090501 38 254 N110901 61 358 C030708 18 210 C060901 42 266 N100601 56 302 C020101 19 215 C080201 40 256 N010901 59 332 C030708 18 210 C030601 36 243 N010901 59 332 C030708 18 210 C030501 41 260 N100701 62 371 C020101 19 215 C030708 39 256 N100701 62 371 C030708 18 210 C030501 41 260 N100701 62 371 N090301 10 192 C030501 41 260 N100701 62 371 C020101 19 215 C030501 41 260 N100701 62 371 C071001 5 170 C021001 29 235 N100501 48 274 C071001 5 170 N090501 38 254 N100701 62 371 C020101 19 215 C030601 36 243 N100701 62 371 C020101 19 215 N090501 38 254 N010901 59 332 C020101 19 215 N090501 38 254 N100701 62 371
From page 322...
... 322 APPENDIX D TABLE D-13 Item ID Table for Quantitative Literacy Bookmark Placements, Round 3, September 2004 Response Participanta Table Probability Occasion 2.1 2 0.67 2 2.2 2 0.67 2 2.3 2 0.67 2 2.4 2 0.67 2 2.5 2 0.67 2 3.1 3 0.67 2 3.2 3 0.67 2 3.3 3 0.67 2 3.4 3 0.67 2 3.5 3 0.67 2 5.1 5 0.67 1 5.2 5 0.67 1 5.3 5 0.67 1 5.4 5 0.67 1 5.5 5 0.67 1 6.1 6 0.67 1 6.2 6 0.67 1 6.3 6 0.67 1 6.4 6 0.67 1 6.5 6 0.67 1 aThe first participant of each table (i.e.
From page 323...
... STANDARD-SETTING SESSION WITH 2003 NAAL DATA 323 Basic Intermediate Advanced Item Round 3 Item Round 3 Item Round 3 Identification BKb SSc Identification BK SS Identification BK SS C070301 10 230 N090101 30 289 N010701 42 319 C020301 16 245 C080801 35 298 C050701 49 356 C070301 10 230 N130601 29 288 C050701 49 356 N120701 17 250 C080801 35 298 C050701 49 356 C020301 16 245 C080801 35 298 C050701 49 356 C020301 16 245 N130601 29 288 N010601 46 338 C020301 16 245 N090101 30 289 C020801 47 343 C020301 16 245 C080801 35 298 C050701 49 356 C020301 16 245 N130601 29 288 N120801 45 331 C020301 16 245 C070301 32 295 C020801 47 343 C020601 15 244 C020801 41 312 N/Ad 461 C020601 15 244 C020801 41 312 N/A 461 C020601 15 244 C030709 37 302 N/A 461 C020601 15 244 C030709 37 302 N130701 51 393 N110801 23 266 C040601 43 324 C040801 53 400 C050301 5 211 C060701 24 267 C050701 49 356 C030706 4 203 C030704 12 240 N121101 50 369 C020601 15 244 C070301 32 295 C050701 49 356 C030704 12 240 N130601 29 288 C020801 47 343 N090901 14 242 C080101 31 290 N120801 45 331
From page 324...
... 324 APPENDIX D Table 1 Occasion 1 Table 2 Occasion 1 Table 4 Occasion 2 Table 5 Occasion 2 FIGURE D-1 Prose literacy cut scores by round for participants at each table, September 2004. Symbols indicate basic ()
From page 325...
... STANDARD-SETTING SESSION WITH 2003 NAAL DATA 325 Table 3 Occasion 1 Table 4 Occasion 1 Table 1 Occasion 2 Table 6 Occasion 2 FIGURE D-2 Document literacy cut scores by round for participants at each table, September 2004. Symbols indicate basic ()
From page 326...
... 326 APPENDIX D Table 5 Occasion 1 Table 6 Occasion 1 Table 2 Occasion 2 Table 3 Occasion 2 FIGURE D-3 Quantitative literacy cut scores by round for participants at each table, September 2004. Symbols indicate basic ()


This material may be derived from roughly machine-read images, and so is provided only to facilitate research.
More information on Chapter Skim is available.