Assessing Accomplished Teaching: Advanced-Level Certification Programs (2008)

Below is the uncorrected machine-read text of this chapter, intended to provide our own search engines and external engines with highly rich, chapter-representative searchable text of each book. Because it is UNCORRECTED material, please consider the following text as a useful but insufficient proxy for the authoritative book pages.

References Abbott, A. (1988). The system of professions: An essay on the division of expert labor. Chi- cago: University of Chicago Press. American Board for Certification of Teacher Excellence. (2007). Elements of the American Board Distinguished TeacherSM. Available: http://www.abcte.org/masterteacher/ [accessed November 20, 2007]. American Educational Research Association. (2006). Standards for reporting on empirical social science research in AERA publications. Washington, DC: Author. American Educational Research Association, American Psychological Association, and Na- tional Council on Measurement in Education. (1999). Standards for educational and psychological testing. Washington, DC: Author. Angrist, J.D., and Lavy, D. (2001). Does teacher training affect pupil learning? Evidence from matched pairings in Jerusalem public schools. Journal of Labor Economics, 19(2), 343-369. Angus, D.L. (2001). Professionalism and the public good: A brief history of teacher certifica- tion. Washington, DC: Thomas B. Fordham Foundation. Arthur, W., Day, E.D., McNelly, T.L., and Edens, P.S. (2003). A meta-analysis of the criterion- related validity of assessment center dimensions. Personnel Psychology, 56(1), 125-154. Baber, A. (2007). State-level testing requirements for teacher certification. Available: http:// www.ecs.org/clearinghouse/72/92/7292.pdf [accessed November 20, 2007]. Ballou, D., and Podgursky, M. (2000). Gaining control of professional licensing and advance- ment. In T. Loveless (Ed.), Conflicting missions: Teachers unions and educational reform. Washington, DC: Brookings Institution. Barfield, S.C., and McEnany, J. (2004). Montana’s national board certified teachers’ views of the certification process. Unpublished article, Montana State University-Billings. Belden, N. (2002). California teachers’ perceptions of national board certification. Santa Cruz, CA: Center for the Future of Teaching and Learning. Ben-Porath, Y. (1967). The production of human capital and the life cycle of earnings. Journal of Political Economy, 75(4), 352-365. 264 

REFERENCES 265 Betts, J.R., Zau, A.C., and Rice, L.A. (2003). Determinants of student achievement: New evidence from San Diego. San Diego: Public Policy Institute of California. Bohrnstedt, G.W., and Stecher, B.M. (Eds.). (2002). What we have learned about class size reduction in California. Sacramento: California Department of Education. Bond, L. (1998a). Culturally responsive pedagogy and the assessment of accomplished teach- ing. Journal of Negro Education, 67(3), 242-254. Bond, L. (1998b). Disparate impact and teacher certification. Journal of Personnel Evaluation in Education, 12(2), 211-220. Bond, L., Smith, T., Baker, W.K., and Hattie, J.A. (2000, September). The certification system of the National Board for Professional Teaching Standards: A construct and consequen- tial validity study. Greensboro: University of North Carolina, Center for Educational Research and Evaluation. Available: http://www.nbpts.org/resources/research/browse_ studies?ID=16 [accessed November 20, 2007]. Boyd, D., Lankford, H., Loeb, S., and Wyckoff, J. (2005). Explaining the short careers of high achieving teachers in schools with low performing students. American Economic Review, 95, 166-171. Bradley, A. (1997). Accreditors shift toward performance. Education Week, 17(9). Available: http://www.edweek.org/ew/articles/1997/10/29/09ncate.h17.html [accessed November 26, 2007]. Cantrell, S., Fullerton, J., Kane, T.J., and Staiger, D.O. (2007). National board certification and teacher effectiveness: Evidence from a random assignment experiment. A paper developed under a grant from the Spencer Foundation and the U.S. Department of Educa- tion. Available: http://harrisschool.uchicago.edu/Programs/beyond/workshops/ppepapers/ fall07-kane.pdf [accessed May 2008]. Carnegie Task Force on Teaching as a Profession. (1986). A nation prepared: Teachers for the 21st century. Hyattsville, MD: Carnegie Forum on Education and the Economy. Carnevale, A.P., Fry, R.A., and Lowell, B.L. (2001). Understanding, speaking, reading, writing, and earnings in the immigrant labor market. The American Economic Review, 91(2), 159-163. Papers and Proceedings of the Hundred Thirteenth Annual Meeting of the American Economic Association, May. Carr-Saunders, A.M., and Wilson, P.A. (1964). The professions. Oxford, England: Clarendon Press. Cavalluzzo, L.C. (2004, November). Is national board certification an effective signal of teacher quality? Alexandria, VA: CNA Corporation. Available: http://www.nbpts.org/ resources/research/browse_studies?ID=11 [accessed November 20, 2007]. Chiswick, B.R., Lee, Y.L., and Miller, P.W. (2002, March). Schooling, literacy, numeracy and labor market success. (IZA Discussion Paper No. 450.) Bonn, Germany: Institute for the Study of Labor (IZA). Available: http://ssrn.com/abstract=305369 [accessed July 2008]. Clotfelter, C., Ladd, H.F., and Vigdor, J.L. (2006, Fall). Teacher-student matching and the assessment of teacher effectiveness. Journal of Human Resources, 41(4), 778-820. Avail- able: http://www.nber.org/papers/w11936 [accessed June 2008]. Clotfelter, C., Ladd, H.F., and Vigdor, J.L. (2007a, March). How and why do teacher cre- dentials matter for student achievement? Working paper 2. National Center for Analysis of Longitudinal Data in Education Research. Available: http://www.caldercenter.org/ PDF/1001058_Teacher_Credentials.pdf [accessed November 27, 2007]. Clotfelter, C., Ladd, H.F., and Vigdor, J.L. (2007b, September). Teacher credentials and student achievement in high school: A cross-subject analysis with student fixed effects. Available: http://www.caldercenter.org/PDF/1001104_Teacher_Credentials_HighSchool. pdf [accessed November 27, 2007]. 

266 ASSESSING ACCOMPLISHED TEACHING Clotfelter, C.T., Ladd, H.F., and Vigdor, J.L. (2007c). Teacher credentials and student achieve- ment: Longitudinal analysis with student fixed effects. Economics of Education Review, 26(6), 673-682. Cohen, C.E., and Rice, J.K. (2005, August). National board certification as professional de- velopment: Design and cost. Arlington, VA: National Board for Professional Teaching Standards. Crocker, L. (1997). Assessing content representativeness of performance assessment exercises. Applied Measurement in Education, 10(1), 83-95. Darling-Hammond, L. (1987). Teacher quality and equality. In P. Keating and J.I. Goodlad (Eds.), Access to knowledge. New York: College Entrance Examination Board. Darling-Hammond, L., and Atkin, J.M. (2007, March). Influences of national board cer- tification on teachers’ classroom assessment practices. Unpublished paper, Stanford University. Datnow, A., and Stringfield, S. (2000). Working together for reliable school reform. Journal of Education for Students Placed at Risk, 5(1 & 2). Dee, T. (2004). Teachers, race, and student achievement in a randomized experiment. Review of Economics and Statistics, 86(1), 195-210. Desimone, L.M., Porter, A.C., Garet, M.S., Yoon, K.S., and Birman, B.F. (2002). Effects of professional development on teachers’ instruction: Results from a three-year longitudinal study. Educational Evaluation and Policy Analysis, 24(2), 81-112. Dilworth, M.E., Aguerrebere, J.A., and Keller-Allen, C. (2006). National Board for Profes- sional Teaching Standards initial thoughts on the reauthorization of the No Child Left Behind Act. Excerpts from unpublished manuscript, May. Available: http://www.nbpts. org/resources/research [accessed November 20, 2007]. Dunbar, S.B., Koretz, D., and Hoover, H.D. (1991). Quality control in development and use of performance assessments. Applied Measurement in Education, 4(4), 289-304. Durkheim, E. (1956). Education and sociology. (Translated with an introduction by S.D. Fox.) Glencoe, IL: Free Press. Education Commission of the States. (2004). ECS report to the nation: State implementation of the No Child Left Behind Act. Denver, CO: Author. Fenstermacher, G.D., and Richardson, V. (2005). On making determinations of teacher quality. Teachers College Record, 107(1), 186-213. Ferguson, R.F., and Ladd, H.F. (1996). How and why money matters: An analysis of Alabama schools. In H.F. Ladd (Ed.), Holding schools accountable: Performance based reform in education. Washington, DC: Brookings Institution. Finn, J.D., and Achilles, C.M. (1999). Tennessee’s class size study: Findings, implications, misconceptions. Educational Evaluation and Policy Analysis, 21(2), 97-109. Freund, M., Russell, V., and Kavulic, C. (2005, May). A study of the role of mentoring in achieving certification by the National Board for Professional Teaching Standards. Available: http://www.nbpts.org/resources/research/browse_studies?ID=19 [accessed July 2008]. Friedman, M. (1995). Public schools: Make them private. CATO Institute Briefing Papers. Washington, DC: CATO Institute. Fullan, M. (2007). The new meaning of educational change. New York: Teachers College Press. Garet, M.S., Porter, A.C., Desimone, L., Birman, B.F., and Yoon, K.S. (2001). What makes professional development effective? Results from a national sample of teachers. American Educational Research Journal, 38(4), 915-945. Goertz, M.E., Floden, R., and O’Day, J. (1995). Studies of education reform: Systemic re- form. Available: http://www.ncela.gwu.edu/pubs/reports/systemwideconf/sysreform.pdf [accessed November 20, 2007]. 

REFERENCES 267 Goldhaber, D., and Anthony, E. (2007). Can teacher quality be effectively assessed? National board certification as a signal of effective teaching. Review of Economics and Statistics, 89(1), 134-150. Goldhaber, D., and Brewer, D. (1997). Why don’t schools and teachers seem to matter? As- sessing the impact of unobservables on educational productivity. Journal of Human Resources, 32(3), 505-523. Goldhaber, D., and Hansen, M. (2007). National board certification and teacher career paths: Does NBPTS certification influence how long teachers remain in the profession and where they teach? Arlington, VA: National Board for Professional Teaching Standards. Available: http://www.nbpts.org/resources/research/browse_studies?ID=184 [accessed November 27, 2007]. Goldhaber, D., Perry, D., and Anthony, E. (2003). Making the grade: Who applies for and earns advanced teacher certification? Washington, DC: Urban Institute. Goodlad, J. (1994). Educational renewal: Better teachers, better schools. San Francisco: Jossey-Bass. Guion, R.M. (1998). Assessment, measurement and prediction for personnel decisions. Mahwah, NJ: Lawrence Erlbaum Associates. Guskey, T.R. (2003). What makes professional development effective? Phi Delta Kappan, 84(10), 748-763. Hannaway, J., and Bischoff, K. (2005, April). Philanthropy and labor market reform in edu- cation: The case of the National Board for Professional Teaching Standards and Teach for America. Prepared for American Enterprise Institute Conference, With the Best of Intentions: Lessons Learned in K-12 Education Philanthropy. Available: http://www.aei. org/event959 [accessed October 2007]. Hanushek, E.A., Kain, J.F., O’Brien, D.M., and Rivkin, S.G. (2005, February). The market for teacher quality. National Bureau of Economic Research. Available: http://www.nber. org/papers/w11154 [accessed November 27, 2007]. Harris, D.N., and Sass, T.R. (2006, August). The effects of NBPTS-certified teachers on stu- dent achievement. Arlington, VA: National Board for Professional Teaching Standards. Available: http://www.nbpts.org/resources/research/browse_studies?ID=139 [accessed November 27, 2007]. Harris, D.N., and Sass, T.R. (2007, February). Teacher training, teacher quality, and student achievement. Available: http://www.caldercenter.org/PDF/1001059_Teacher_Training.pdf [accessed November 27, 2007]. Hattie, J. (1996, April). Validating the specification of a complex content domain. Paper presented at the annual conference of the American Educational Research Association, New York. Hattie, J. (2008). Validating the specifications for teaching. Applications to the National Board for Professional Teaching Standards’ assessments. In L.C. Ingvarson and J. Hattie (Eds.), Assessing teachers for professional certification: The first decade of the National Board for Professional Teaching Standards (pp. 93-112). Amsterdam: Elsevier/JAI Press. Hawley, W., and Valli, L. (1999). The essentials of effective professional development: A new consensus. In L. Darling-Hammond and G. Sykes (Eds.), Teaching as the learning profes- sion: Handbook of policy and practice (pp. 127-150). San Francisco: Jossey-Bass. Helding, K.A., and Fraser, B.J. (2005, April). Effectiveness of national board certified teachers in terms of attitudes, classroom environments and achievement among secondary science students. Paper presented at the annual meeting of the American Educational Research Association, Montreal, Canada. Hendrie, C. (2004). High schools nationwide pairing down. Education Week, June 16. Hess, F.M. (2004, April-May). Teacher quality, teacher pay. Available: http://www.hoover. org/publications/policyreview/3438676.html [accessed May 28, 2008]. 

268 ASSESSING ACCOMPLISHED TEACHING Hiebert, J., Gallimore, R., and Stigler, J.W. (2002). A knowledge base for teaching profes- sion: What would it look like and how can we get one? Educational Researcher, 31(5), 3-15. Humphrey, D.C., Koppich, J.E., and Hough, H.J. (2005). Sharing the wealth: National board certified teachers and the students who need them most. Education Policy Analysis Archives, 13(18). Available: http://epaa.asu.edu/epaa/v13n18/v13n18.pdf [accessed June 2008]. Indiana Professional Standards Board. (2002, Spring). Status of national board certified teach- ers in Indiana. Indianapolis: Author. Available: http://www.nbpts.org/resources/research/ browse_studies?ID=26 [accessed November 27, 2007]. Ingersoll, R. (2001). Teacher turnover and teacher shortages: An organizational analysis. American Educational Research Journal, 38(3), 499-534. Ingersoll, R. (2002a). Teacher quality and educational inequality: The case of Title 1 schools. In M. Wang and K. Wong (Eds.), Efficiency, accountability, and equity issues in Title I schoolwide program implementation (pp. 149-182). Greenwich, CT: Information Age Press. Ingersoll, R. (2002b). The teacher shortages: A case of wrong diagnosis and wrong prescrip- tion. NASSP Bulletin, 86(631),16-31. Ingersoll, R. (2008). Teacher quality, educational inequality, and the organization of schools. In A.R. Sadovnik, J. O’Day, G. Bohrnstedt, and K. Borman (Eds.), No Child Left Behind and the reduction of the achievement gap: Sociological perspectives on federal educa- tional policy (pp. 153-175). New York: Routledge. Ingersoll, R., and Perda, D. (2008). [National data on the destination schools of teacher transfers and movers.] Unpublished raw data. Ingvarson, L.C., and Hattie, J. (Eds). (2008). Assessing teachers for professional certification: The first decade of the National Board for Professional Teaching Standards. Amsterdam: Elsevier/JAI Press. Jacob, B.A., and Lefgren, L. (2004). The impact of teacher training on student achievement: Quasi-experimental evidence from school reform efforts in Chicago. Journal of Human Resources, 39(1), 50-79. Jaeger, R.M. (1998). Evaluating the psychometric qualities of the National Board for Profes- sional Teaching Standards’ assessments: A methodological accounting. Journal of Person- nel Evaluation in Education, 12(2), 189-210. Jaeger, R.M., Hambleton, R.L., and Plake, B.S. (1995, April). Eliciting configural perfor- mance standards through a sequenced application of complementary methods. Paper presented at the annual meeting of the American Educational Research Association, San Francisco. Jencks, C., Bartlett, S., Corcoran, M., Crouse, J., Eaglesfield, D., Jackson, G., McClelland, K., Mueser, P., Olneck, M., Schwartz, J., Ward, S., and Williams, J. (1979). Who gets ahead? The determinants of economic successes in America. New York: Basic Books. Joint Committee on Standards for Educational Evaluation. (1994). The program evaluation standards: How to assess evaluations of educational programs, 2nd edition. Thousand Oaks, CA: Sage. Keller, B. (2006). NBPTS upgrades profession, most agree, despite test-score letdown. Educa- tion Week, 25(40), 1-14. Knapp, J.L., McNergney, R.F., Herbert, J.J., and York, H.L. (1990). Should a master’s degree be required of all teachers? Journal of Teacher Education, 41(2), 27-37. Koppich, J.E., Humphrey, D.C., and Hough, H.J. (2006). Making use of what teachers know and can do: Policy practice, and national board certification. Education Policy Analysis Archives, 15(7), 1-30. 

REFERENCES 269 Kraft, N.P. (2001). Standards in teacher education: A critical analysis of NCATE, INTASC, and NBPTS (A Conceptual Paper/Review of the Research). In J. Kincheloe and D. Weil (Eds.), Standards and schooling in the United States: An encyclopedia. Santa Barbara, CA: ABC-CLIO. Labaree, D.F. (2000). On the nature of teaching and teacher education: Difficult practices that look easy. Journal of Teacher Education, 51(3), 228-233. Labaree, D.F. (2004). The trouble with ed schools. New Haven: Yale University Press. Ladd, H., Sass, T.R., and Harris, D.N. (2007). The impact of national board certified teachers on student achievement in Florida and North Carolina. Paper prepared for the Com- mittee on Evaluation of Teacher Certification by the National Board for Professional Teaching Standards. Available: http://www7.nationalacademies.org/bota/NBPTS-MTG4- Sass-paper.pdf [accessed November 27, 2007]. Levine, A. (2006). Educating school teachers. Washington, DC: Education Schools Project. Lewis, C., and Tsuchida, I. (1998). A lesson is like a swiftly flowing river: Research lessons and the improvement of Japanese education. American Educator, Winter, 12-17, 50-52. Linn, R.L. (1993). Linking results of distinct assessments. Applied Measurement in Education, 6(1), 83-102. Little, J.W. (1990). The persistence of privacy: Autonomy and initiative in teachers’ profes- sional relations. Teachers College Record, 91(4), 509-536. Lockwood, J.R., McCaffrey, D.F., Hamilton, L., Stecher, B., Le, V., and Martinez, F. (2007). The sensitivity of value-added teacher effect estimates to different mathematics achieve- ment measures. Journal of Educational Measurement, 44(1), 47-67. Lord, B. (1994). Teachers’ professional development: Critical colleagueship and the role of professional communities. In N. Cobb (Ed.), The future of education: Perspectives on national standards in America. New York: College Board. Lortie, D.C. (2002). Schoolteacher (2nd edition). Chicago: University of Chicago Press. Loyd, B. (1995, February). Content validation of the National Board for Professional Teach- ing Standards early adolescence generalist assessment (technical report). Arlington, VA: National Board for Professional Teaching Standards. Lucas, C.J. (1999). Teacher education in America. New York: St. Martin’s Press. Lustick, D., and Sykes, G. (2006). National board certification as professional development: What are teachers learning? Education Policy Analysis Archives, 14(5). Available: http:// epaa.asu.edu/epaa/v14n5 [accessed March 1, 2006]. Marcoulides, G.A. (1990). An alternative method for estimating variance components in generalizability theory. Psychological Reports, 66(2), 379-386. McCaffrey, D.F., and Rivkin, S.G. (2007). Empirical investigations of the effects of national board teacher standards certified teachers on student outcomes. Paper prepared for the Committee on Evaluation of Teacher Certification by the National Board for Professional Teaching Standards. Available: http://www7.nationalacademies.org/bota/NBPTS-MTG4- McCaffrey-Paper.pdf [accessed November 27, 2007]. McColskey, W., Stronge, J.H., Ward, T.J., Tucker, P.D., Howard, B., Lewis, K., and Hindman, J.L. (2005, June). Teacher effectiveness, student achievement, and national board certified teachers. Arlington, VA: National Board for Professional Teaching Standards. Available: http://www.nbpts.org/UserFiles/File/Teacher_Effectiveness_Student_Achievement_and_ National_Board_Certified_Teachers_D_-_McColskey.pdf [accessed June 2008]. McIntosh, S., and Vignoles, A. (2001). Measuring and assessing the impact of basic skills on labour market outcomes. Oxford Economic Papers, 53, 453-481. McLaughlin, M.W., and Talbert, J.E. (2001). Professional communities and the work of high school teaching. Chicago: University of Chicago Press. Monk, D.H. (1994). Subject area preparation of secondary math and science teachers and student achievement. Economics of Education Review, 13(2), 125-145. 

270 ASSESSING ACCOMPLISHED TEACHING Moore, J.W. (2002, December). Perceived barriers to the National Board for Professional Teaching Standards certification. Unpublished dissertation, East Tennessee State University. Murray, F.B. (2001). From consensus standards to evidence of claims: Assessment and ac- creditation in the case of teacher education. New Directions for Higher Education, 2001(113), 49-66. National Board for Professional Teaching Standards. (1991). Initial policies and perspec- tives of the National Board for Professional Teaching Standards (3rd edition). Detroit: Author. National Board for Professional Teaching Standards. (1998). Middle childhood through early adolescence/mathematics standards. Arlington, VA: Author. Available: http://www. nbpts.org/the_standards/standards_by_cert?ID=8&x=36&y=5 [accessed November 26, 2007]. National Board for Professional Teaching Standards. (1999). What teachers should know and be able to do. Arlington, VA: Author. National Board for Professional Teaching Standards. (2001a). I am a better teacher. Arlington, VA: Author. Available: http://www.nbpts.org/resources/research/browse_studies?ID=25 [accessed November 27, 2007]. National Board for Professional Teaching Standards. (2001b). Middle childhood general- ist standards. Arlington, VA: Author. Available: http://www.nbpts.org/the_standards/ standards_by_cert?ID=27&x=47&y=6 [accessed November 26, 2007]. National Board for Professional Teaching Standards. (2001c). NBPTS middle childhood gen- eralist standards (2nd edition). Arlington, VA: Author. Available: http://www.nbpts.org/ the_standards/standards_by_cert?ID=27&x=51&y=10 [accessed November 20, 2007]. National Board for Professional Teaching Standards. (2001d). The impact of national board certification on teachers: A survey of national board-certified teachers and assessors. An NBPTS research report. Arlington, VA: Author. Available: http://www.nbpts.org/­ resources/research/browse_studies?ID=23 [accessed November 20, 2007]. National Board for Professional Teaching Standards. (2001e). National board certification candidate survey. Arlington, VA: Author. National Board for Professional Teaching Standards. (2006a). 2006 guide to national board certification. Arlington, VA: Author. Available: http://www.nbpts.org/UserFiles/ File/51049_web.pdf [accessed November 20, 2007]. National Board for Professional Teaching Standards. (2006b). Middle child generalist scor- ing guide, effective 2006. Arlington, VA: Author. Available: http://www.nbpts.org/ for_candidates/scoring?ID=27&x=59&y=3 [accessed November 20, 2007]. National Board for Professional Teaching Standards. (2006c). Early adolescence mathematics scoring guide, effective 2006. Arlington, VA: Author. Available: http://www.nbpts.org/ index.cfm?t=downloader.cfm&id=464 [accessed November 26, 2007]. National Board for Professional Teaching Standards. (2006d). Early adolescence mathe- matics portfolio instructions. Arlington, VA: Author. Available: http://www.nbpts.org/ for_candidates/the_portfolio?ID=8&x=63&y=10 [accessed November 26, 2007]. National Board for Professional Teaching Standards. (2006e). Middle childhood general- ist portfolio instructions. Arlington, VA: Author. Available: http://www.nbpts.org/ for_candidates/the_portfolio?ID=27&x=63&y=8 [accessed November 26, 2007]. National Board for Professional Teaching Standards. (2006f, May). Standards development handbook. Arlington, VA: Author. National Board for Professional Teaching Standards. (2007, March). Technical report: Draft. Arlington, VA: Author. National Commission for Certifying Agencies. (2004). Standards for the accreditation of certifi- cation programs. Washington, DC: National Organization for Competency Assurance. 

REFERENCES 271 National Commission on Excellence in Education. (1983). A nation at risk: The imperative for educational reform. Washington, DC: U.S. Department of Education. National Commission on Excellence in Education. (1984). A nation at risk: The full account. Portland, OR: USA Research. National Commission on Teaching and America’s Future. (2003). No dream denied: A pledge to America’s children. Washington, DC: Author. National Council for Accreditation of Teacher Education. (2004). NCATE at 50: Con- tinuous growth, renewal, and reform. Available: http://www.ncate.org/documents/ 15YearsofGrowth.pdf [accessed November 2007]. National Council on Teacher Quality. (2004). Searching the attic: How states are responding to the nation’s goal of placing a highly qualified teacher in every classroom. NCTQ Re- ports. Available: http://www.nctq.org/nctq/publications [accessed November 2007]. National Research Council. (2001). Testing teacher candidates: The role of licensure tests in improving teacher quality. Committee on Assessment and Teacher Quality, K.J. Mitchell, D.Z. Robinson, B.S. Plake, and K.T. Knowles (Eds.). Board on Testing and Assessment, Center for Education, Division of Behavioral and Social Sciences and Education. Wash- ington, DC: National Academy Press. National Research Council. (2002). Scientific research in education. Committee on Scientific Principles for Education Research, R.J. Shavelson and L. Towne (Eds.). Center for Education, Division of Behavioral and Social Sciences and Education. Washington, DC: National Academy Press. Norcini, J.J., Lipner, R.S., and Kimball, H.R. (2002). Certifying examination performance and patient outcomes following acute myocardial infarction. Medical Education, 36, 853-859. Nye, B., Spyros, K., and Hedges, L.V. (2004). How large are teacher effects? Educational Evaluation and Policy Analysis, 26(3), 237-257. Oakes, J. (1990). Multiplying inequalities: The effects of race, social class, and tracking on op- portunities to learn mathematics and science. Santa Monica, CA: RAND Corporation. Palmer, P., Hartke, D.D., Ree, M.J., Welsh, J.R., and Valentine, L.D. (1988). Armed services vocational aptitude battery (ASVAB): Alternative forms reliability (Forms 8, 9, 10 and 11). (AFHRL-TP No. 87-48.) Brooks Air Force Base, TX: Air Force Human Resources Laboratory. Pedhazur, E.J. (1982). Multiple regression in behavioral research. Ft. Worth, TX: Harcourt Brace Jovanovich. Perda, D. (2007, June). Who are the national board certified teachers? Paper prepared for the Committee on Evaluation of Teacher Certification by the National Board for Professional Teaching Standards. Plake, B.S., Hambleton, R.K., and Jaeger, R.M. (1997). A new standard-setting method for performance assessments: The dominant profile judgment method and some field test results. Educational and Psychological Measurement, 57, 400-411. Porter, A.C., Garet, M.S., Desimone, L., Yoon, K.S., and Birman, B.F. (2000, October). Does professional development change teaching practice? Results from a three-year study. Report to the U.S. Department of Education, Office of the Under Secretary, on Contract No. EA97001001 to the American Institutes for Research. Washington, DC: Pelavin Research Center. Raudenbush, S., Fotiu, R., and Cheong, Y. (1998). Inequality of access to educational re- sources. Educational Evaluation and Policy Analysis, 20, 253-267. Reynolds, D.J. (1999). Assessing the assessor: Understanding the reliability of assessor judg- ment. Paper presented at the 27th International Congress on Assessment Center Methods, Orlando, FL. 

272 ASSESSING ACCOMPLISHED TEACHING Richardson, V. (Ed.). (2001). Handbook of research on teaching (4th edition). Washington, DC: American Educational Research Association. Rivkin, S.G., Hanushek, E.A., and Kain, J.F. (2005, March). Teachers, schools, and academic achievement. Econometrica, 73(2), 417-458. Rossi, P.H., Lipsey, M.W., and Freeman, H.E. (2004). Evaluation: A systematic approach. Thousand Oaks, CA: Sage. Rotherham, A. (2004, March). Opportunity and responsibility for national board certified teachers. Progressive Policy Institute Policy Report. Washington, DC: Progressive Policy Institute. Rothstein, J. (2008, April). Unobserved heterogeneity, fixed effects, and causal inference. Paper presented at the National Conference on Value-Added Modeling, Madison, WI. Russell, T., Putka, D., and Waters, S. (2007, October). Review of the psychometric quality of the national board assessments. Paper prepared for the Committee on Evaluation of Teacher Certification by the National Board for Professional Teaching Standards. Sackett, P.R., Schmitt, N., Ellingson, J.E., and Kabin, M.B. (2001). High stakes testing in employment, credentialing, and higher education: Prospects in a post-affirmative action world. American Psychologist, 56, 302-318. Sanders, W.J., Ashton, J.J., and Wright, S.P. (2005). Comparison of the effects of NBPTS- certified teachers with other teachers on the rate of student academic progress. Arlington, VA: National Board for Professional Teaching Standards. Available: http://www.nbpts. org/resources/research/browse_studies?ID=15 [accessed November 27, 2007]. Schön, D.A. (1983). The reflective practitioner: How professionals think in action. New York: Basic Books. Scriven, M. (1991). Evaluation thesaurus (4th edition). Thousand Oaks, CA: Sage. Sedlak, M., and Schlossman, S. (1986). Who will teach? Historical perspectives on the chang- ing appeal of teaching as a profession. Center for the Study of the Teaching Profession, RAND Corporation. Sewell, W.H., Hauser, R.M., and Featherman, D.L. (Eds.). (1976). Schooling and achievement in American society. New York: Academic Press. Shulman, L.S., and Sykes, G. (1986). A national board for teachers? In search of a bold stan- dard. Paper prepared for the Task Force on Teaching as a Profession. Carnegie Forum on Education and the Economy. New York: Carnegie Corporation. Smith, T.W., Gordon, B., Colby, S.A., and Wang, J. (2005). An examination of the relation- ship between depth of student learning and national board-certification status. Arlington, VA: National Board for Professional Teaching Standards. Available: http://www.nbpts. org/UserFiles/File/Applachian_State_study_D_-_Smith.pdf [accessed June 2008]. Society for Industrial and Organizational Psychology. (2003). Principles for the validation and use of personnel selection procedures. Bowling Green, OH: Author. Stecher, B.M., Bohrnstedt, G.W., Kirst, M., McRobbie, J., and Williams, T. (2001). Class-size reduction in California: A story of hope, promise, and unintended consequences. Phi Delta Kappan, 82(9), 670-674. Stevenson, H.W., and Stigler, J.W. (1992). The learning gap: Why our schools are failing and what we can learn from Japanese and Chinese education. New York: Simon & Schuster. Stigler, J., and Hiebert, J. (1997). Understanding and improving mathematics instruction: An overview of the TIMSS video study. Phi Delta Kappan, 79(1), 14-21. Stinebrickner, T., Scafidi, B., and Sjoquist, D. (2003). The relationship between school char- acteristics and teacher mobility. Unpublished manuscript, University of Western Ontario, Department of Economics. 

REFERENCES 273 Stone, J.E. (2002). The value-added achievement gains of NBPTS-certified teachers in Tennes- see: A brief report. Johnson City, TN: Education Consumers Clearinghouse. Available: http://www.education-consumers.com/briefs/stoneNBPTS.shtm [accessed June 2008]. Sykes, G., and Wilson, S. (1988). Professional standards for teaching: The assessment of teacher knowledge and skills. Charleston, WV: Appalachia Educational Laboratory. Sykes, G., Anagnostopoulos, D., Cannata, M., Chard, L., Frank, K., McCrory, R., and Wolfe, E. (2006). National board-certified teachers as organizational resource. Arlington, VA: National Board for Professional Teaching Standards. Available: http://www.nbpts.org/ resources/research/browse_studies?ID=174 [accessed November 27, 2007]. Tamblyn, R., Abrahamowicz, M., Brailovsky, C., Grand’Maison, P., Lescop, J., Norcini, J., Girard, N., and Haggerty, J. (1998). Association between licensing examination scores and resource use and quality of care in primary care practice. Journal of the American Medical Association, 280(11), 989-996. Tamblyn, R., Abrahamowicz, M., Dauphinee, W.D., Hanley, J.A., Norcini, J., Girard, N., Grand’Maison, P., and Brailovsky, C. (2002). Journal of the American Medical Associa- tion, 288(23), 3019-3026. Tom, A.R. (1984). Teaching as a moral craft. New York: Longman. Tsacoumis, S. (2007). Assessment centers. In D.L. Whetzel and G.R. Wheaton (Eds.), Applied measurement: Industrial psychology in human resources management. Mahwah, NJ: Lawrence Erlbaum. Tucker, M. (1995). A nation prepared: Teachers for the 21st century. Report of the Carnegie Forum on Education and the Economy’s Task Force on Teaching as a Profession. In D.N. Planck (Ed.), Commissions, reports, reforms, & educational policy. Westport, CT: Greenwood Publishing Group. Tyack, D., and Cuban, L. (1996). Tinkering toward utopia: A century of public school reform. Cambridge, MA: Harvard University Press. Tyler, J.H., Murnane, R.J., and Willett, J.B. (2000, May). Estimating the labor market signal- ing value of the GED. Quarterly Journal of Economics, 115(2), 431-468. U.S. Department of Education. (2001). Public law print of the No Child Left Behind Act of 2001. Available: http://www.ed.gov/policy/elsec/leg/esea02/index.html [accessed July 2007]. U.S. Department of Education, Office of Postsecondary Education. (2006). The Secretary’s fifth annual report on teacher quality: A highly qualified teacher in every classroom. Washington, DC: Author. Vandervoort, L.G., Amrein-Beardsley, A., and Berliner, D.C. (2004). ������������������������� National board certified teachers and their students’ achievement. Education Policy Analysis Archives, 12(46). Walsh, K., and Jacobs, S. (2007). Alternative certification isn’t alternative. Thomas B. Ford- ham Institute, National Council on Teacher Quality. Available: http://www.heartland. org/pdf/22264.pdf [accessed June 2008]. Wang, J., and Paine, L.W. (2003). Learning to teach with mandated curriculum and public examination of teaching as contexts. Teaching and Teacher Education, 19(1), 75-94. Wayne, A.J. (2002). Teacher inequality: New evidence on disparities in teachers’ academic skills. Education Policy Analysis Archives, 10(3). Available: http://epaa.asu.edu/epaa/ v10n30/ [accessed July 2008]. Wayne, A., Chang-Ross, C., Daniels, M., Knowles, K., Mitchell, K., and Price, T. (2004). Exploring differences in minority and majority teachers’ decisions about and preparation for NBPTS certification. Arlington, VA: SRI International. Wilensky, H.L. (1964). The professionalization of everyone? American Journal of Sociology, 70(2), 137-158. Wilson, S.M., and Berne, J. (1999). Teacher learning and the acquisition of professional knowledge: An examination of research on contemporary professional development. Review of Research in Education, 24, 173-209.