... Proposing a Research and Development Agenda...

... In designing a research and development agenda, the committee considered the mechanisms through which research influences practice, in light of the feedback received at the two ...

... of the figure are worth noting again here. First, the influence of research on the four mediating arenas—education materials, pre-service and in-service teacher and administrator education programs, public policy, and public opinion and the media—has typically been weak for the ... of reasons discussed earlier. Without clear communication of a research-based theory of learning and teaching, the operational theories held by the various stakeholders are not aligned. Teachers, administrators, and parents frequently encounter ... ideas about the nature of learning and its implications for effective teaching....

... Second, with the exception of the relatively small set of cases in which teachers and researchers work together on design experiments, the arrows between research and practice in Figure 1.1 are one-way. This reflects the fact that ... typically have few opportunities to shape the research agenda and contribute to an emerging knowledge base of learning and teaching. The task of bridging research and practice requires an agenda that allows for a flow of information, ideas, and research questions in both ... . It requires an agenda that consolidates the knowledge base and strengthens the links between that knowledge base and each of the components that together influence practice....

... The potential benefits of bridging theory and practice are noted by Donald Stokes in his recent work, Pasteur's Quadrant (1997). Stokes observed that many of the advances in science are ... to the search for solutions to practical problems. Pasteur appears in the book's title because his work contributed so clearly to scientific understanding while simultaneously focusing on practical problems. Such research is "use-inspired." As in Pasteur's case, when executed as part of a systematic ... strategic program of inquiry, it can support new understandings at the most fundamental and basic scientific level....

... is that the typical linear conceptualization of research as a sequence from basic to applied is an inaccurate characterization of much research, and it is highly limiting for the envisioning of a research agenda. He proposes instead a quadrant in two-dimensional space in which considerations of ... and the quest for fundamental understanding define the horizontal and vertical axes respectively. The quadrant allows for the possibility that research can be high in both basic and applied values....

... comprehensive program of use-driven strategic research and development focused on issues of improving classroom learning and teaching. The facts that schools and classrooms are the focus and that enhanced practice and learning are the desired goals render the program of research no less important with ...

... It is worth noting that a wide array of quantitative and qualitative methods drawn from the behavioral and social sciences are employed in education research. The methods often vary with the nature of the learning and teaching problem studied and the level ... in real-world contexts in which variables are often difficult to control, the types of "use-inspired" research that we envision will necessarily demand a variety of methods. These will range from controlled designs to case studies, with analytic methods for deriving conclusions and inferences ... both quantitative and qualitative procedures of substantial rigor. To build an effective bridge between research and practice, such a multiplicity of methods is not only reasonable, it is essential. No single research method can suffice....

... Adopting the perspective of use-inspired, strategic research and development focused on issues of learning and teaching is a powerful way to organize and justify the specific project areas we describe. In light of the many comments of workshop participants, ... committee identified five overarching themes that guided our understanding of the change that is required to bridge research and practice more effectively. Three of these themes point to the consolidation of knowledge that would help link research and practice:...

... Elaborate the messages in How People Learn at a level of detail that makes them usable to educators and policy makers. Workshop participants were enthusiastic about the report and its implications for classroom teaching. They were virtually unanimous, ... , in the view that the findings and their implications need to be substantially elaborated and incorporated into curricula, instructional tools, and assessment tools before their impact will be felt in the classroom. It is not enough to know, for example, that subject-matter information must be ... to related concepts if deep understanding and transfer of learning are the goals. Teachers must recognize which particular concepts are most relevant for the subject matter that they teach. And ... to link information with concepts. Similarly, policy makers need to know quite specifically how the principles in How People Learn relate to state standards. In this sense, the development aspect of the agenda is critical....

... People Learn in the manner that is most effective for each of the audiences that influences educational practice. For teachers to teach differently and administrators and policy makers to support a different model of teaching, they need opportunities to learn about the recommended changes and to ... what they are designed to achieve. Research must be done on effective methods of communicating these ideas to teachers, administrators, and policy makers, each of whom have different information needs and different ways of learning. Similarly, teachers, administrators, and policy makers ...

... in How People Learn as a lens through which to evaluate existing education practices and policies. How People Learn emphasizes that many existing school practices and policies are inconsistent with what is known about learning. But there are also havens of exemplary educational practice, and the ...

... Moreover, educators emphasized that new ideas are introduced to schools one after another, and teachers become weary and skeptical that any new reform effort will be better than the last. Zealous efforts to promote the ...

... Together, these three themes suggest that an effective bridge between research and practice will require a consolidated knowledge base on learning and teaching that builds, or is cumulative, over time. Elaborating on the committee's conceptualization in Figure 1.1, this knowledge base appears at the ... of Figure 4.1. Fed by research, it organizes, synthesizes, interprets, and communicates research findings in a manner that allows easy access and effective learning for those in each of the mediating arenas. Attending to the communication and information links between the knowledge base and ... of the components of the model simultaneously enhances the prospect for the alignment of research ideas and practice....

... Two additional themes that emerged from the discussions focus on how research should be conducted to strengthen its link to practice:...

... Conduct research in teams that combine the expertise of researchers and the wisdom of practitioners. Much of the work that is needed to bridge research and practice focuses on the education and professional development of ... , the curriculum, instruction and assessment tools that support their teaching, and the policies that define, the environment in which reaching takes place. These are areas about which practitioners have a great deal of knowledge and ... the need to have educators partnered with researchers in undertaking taking these search projects. Such partnerships allow the perspectives and...

... Proposed model for strengthening the link between research and practice....

... knowledge of teachers to be tapped, bringing an awareness to the research of the needs and dynamics of a classroom environment. Since such partnerships are novel to many researchers, exemplary cases and guiding principles will need to be ... to make more likely the successful planning and conduct of research team partnerships....

... Extend the frontier of learning research by expanding the study of classroom practice. Researchers and practitioners who participated in the workshops recommended expansion of research efforts that begin by observing the learning that takes place in ... classroom. This research, as the earlier discussion of the Stokes work suggests, may advance understanding of the science of learning in important and useful ways....

... Take together, these latter two suggestions imply that the links between research and practice should routinely flow in both directions. The insights...

... of researchers help shape the practitioner's understanding, and the insights of practitioners help shape research agenda and the insights of researchers. Moreover, the link between each of the arenas and the knowledge base flows in both directions. Efforts to align teaching ... , teacher education, administration, public policy, and public opinion with the knowledge base are part of an ongoing, iterative research effort in which the implementation of new ideas, teaching ...

... The agenda that follows proposes research and development that can help consolidate the knowledge base (which appears at the center of Figure 2.1) and can build the two-way links between the knowledge base and each of the arenas that influences practice. But that knowledge base is also fed by ... on learning more generally and on classroom practice. The committee also suggests additional research that would strengthen the understanding of learning in areas that go beyond How People Learn....

... Finally, since communication and access to knowledge are key to alignment, the committee proposes a new effort to use interactive technologies to facilitate communication of the ... of findings that would emerge from these research and development projects....

... In many of the proposed areas for research and development, work is already under way. Inclusion in the agenda is not meant to overlook the contributions of research already done or in progress. ... , we are inclusive in order to suggest that research findings need to be synthesized and integrated into the knowledge base and their implications tested through ongoing, iterative research....

... Research and Development of Educational Materials...

... The goal of the recommended research and development in this area is to build on and elaborate findings in How People Learn so that they are "applications ready" and more usable to those responsible for developing curriculum, ... , and assessment materials. It is designed to achieve three interrelate goals: (a) to identify existing educational materials that are aligned with the ... of learning suggested by the report and to develop and test new materials in areas of need, (b) to advance the knowledge base by significantly extending the work described in How People Learn to ... areas of curriculum, instructional techniques, and assessments that are in need of detailed analysis, and (c) to communicate the messages in How People Learn in a manner appropriate to developers of educational...

... materials and teachers by using a variety of technologies (e.g., texts, electronic databases, interactive web sites). The research we recommend is described in ...

... 1. Review a sample of current curricula, instructional techniques, and assessments for alignment with principles discussed in How People Learn. The committee recommends that teams of discipline-specific experts, ... in pedagogy oil cognitive science, and teachers review a sample of widely used curricula, as well as curricula that have a reputation for reaching for understanding. The envisioned ...

... Stage 1: These curricula and their companion instructional techniques and assessments should be evaluated with careful attention paid to alignment with the principles of learning outlined in How People Learn. The review ... adequacy of the factual knowledge base provided by the curriculum; the extent to which formative assessment procedures are built into the curriculum; and the extent to which accompanying summative assessment procedures measure understanding and ability to transfer rather than memory of fact....

... The features that support learning should be highlighted and explained, as should the features that are in conflict. The report from this research should accomplish two goals. First, it should identify examples ... curriculum components, instructional, techniques, and assessment tools that incorporate the principles of learning. Second, the explication of features that support or conflict with the principles of ... should be provided in sufficient detail and in a format that allows the report to serve as a learning device for those in the education field who choose and use teaching and assessment tools. ... such, it could serve as a reference document when new curricula and assessments are being considered....

... in the light of classroom practice may fail to achieve the level of understanding for which they are designed. Measures of student achievement take center stage in this effort. Through the lens of How People Learn, achievement ... indicated not only by a command of factual knowledge, but also by a student's conceptual understanding of subject matter and the ability to apply those concepts to future learning of new, related material. If existing assessments do not measure conceptual understanding and ... transfer, then this stage will require development and testing of such measures. In addition to achievement scores, feedback from teachers and curriculum directors who use the materials would provide additional input for stage 2....

... would take place at several levels: at the of curriculum units, which may span several weeks of instructional time; at the level of semester-long and year-long sequences of units; and at the level of multiple grades, so that students have chances to progressively deepen their understanding over a ...

... that are print based. As a subset of this effort, the committee recommends a review of curricula that are multimedia. The number of computers in schools is expanding rapidly. For schools to use that equipment to support learning, they must be able to identify the computer-based programs that can ...

... Identify technology programs or computer-based curricula that are aligned with the principles of learning for understanding. The programs identified should go beyond those that are add-ons of factual information or that simply provide information in an entertaining ... . The investigation should explore how the programs can be used as a tool to support knowledge-building in the unit being studied, and how they can further enhance the development of understanding of key concepts in the unit. The study should also explore the adequacy of ... for learning about the programs and for ongoing support in using the programs in a classroom setting;...

... Evaluate the aligned programs as teaching/learning tools by conducting empirical research on their distinctive contribution to achievement and other desired outcomes....

... Investigate computer programs that appear to be effective teaching devices but do not clearly align with the principles of learning. These might suggest productive areas for further study....

... Extend the Knowledge Base by Developing and Testing New Educational Materials...

... 2. In areas in which curriculum development has been weak, design and evaluate new curricula, with companion assessment tools, that teach and measure deep understanding. As an extension of Recommendation 1 above, or in some cases as a substitute, the committee recommends the development and ... of new curriculum and assessment materials that reflect the principles of learning outlined in How People Learn. Once again, the committee recommends that the development ... done by teams of disciplinary experts, cognitive scientists, curriculum developers, and expert teachers. Ideally, research in this category will begin with existing curricula and modify them to better reflect key principles of learning. ... some cases, however, exemplary curricula for particular kinds of subject matter may not exist, so the teams will need to create them. This research and development might be coordinated with the ongoing efforts of the National Science Foundation to ensure complementary rather than duplicative efforts....

... The curricula should be designed to support learning for understanding. They will presumably emphasize depth over breadth. The designs should engage students' initial understanding, promote construction of a ... of factual knowledge in the context of a general conceptual framework, and encourage the development of metacognitive skills....

... should include a ''meta-guide" that explains its links to principles of learning, reflects pedagogical content knowledge concerning the curriculum, and promotes flexible use of the curriculum by teachers. The guide should include discussion of expected prior knowledge (including typical ... ), expected competencies required of students, and ways to carry out formative assessments as learning proceeds. Potentially excellent curricula can fail because teachers are not given adequate ... to use them. Although instructional guides cannot replace teacher training charts, the meta-guide should be both comprehensive and user-friendly to supplement those effects. Finally, both formative and summative tests of learning and transfer should be proposed as well....

... Once developed, the committee recommends field-testing of the curricula in order to amass data on student learning and teacher satisfaction, identifying areas for improvement. Clearly, it is easier to field-test short units than longer ones. Ideally, different ...

... elementary, middle, and high school) would work to explore the degree to which each of the parts seems to merge into a coherent whole....

... The committee recommends once again that careful attention be paid to the criteria used to evaluate the learning that is supported by the materials and accompanying pedagogy. Achievement should measure understanding of concepts and ability to transfer learning to new, related areas....

... effort on formative assessment. The importance of making students' thinking visible by providing frequent opportunities for assessment, feedback, and revision, as well as teaching students to engage in self-assessment, is emphasized in How People Learn and in the proposals above. But the knowledge ... on how to do this effectively is still weak. To bolster the understanding of formative assessment so that it can more effectively be built into curricula, this research effort should:...

... for formative assessments that promote the development of coherent, well-organized knowledge. The goal of these assessments is to tap understanding rather than memory for procedures and facts;...

... Experiment with approaches to developing in students and teachers a view of formative assessment and self-assessment as an opportunity for providing useful information that allows for growth, rather than as an outcome measure of success or failure;...

... Explore the potential of new technologies that provide the opportunity to incorporate formative assessment into teaching in an efficient and user-friendly fashion....

... This research effort should consider as well the relationship between formative and summative assessments. If the goal of learning is to achieve deep understanding, then formative assessment should identify problems and progress ... that goal, and summative assessment should measure the level of success at reaching that goal. Clearly they are different stages of the same process and should be closely tied in design and purpose....

... 4. Develop and evaluate videotaped model lessons for broadly taught, common curriculum units that appear throughout the K-12 education system. Many lessons and ... to students in the United States. Examples include the rain cycle in science, the concept of gravity in physics, the Civil War in history, and Macbeth in English. The committee recommends that a sample of familiar teaching topics be chosen to illustrate teaching methods that are compatible...

... with the findings of How People Learn. The research and development should be undertaken by teams composed of disciplinary experts, pedagogical experts, master teachers, and video specialists. The model ...

... Illustrate a methodology for drawing out and working with student preconceptions and assessing progress toward understanding (results from project area 5 below could contribute to this endeavor);...

... Present the conceptual framework for understanding or organizing the new material;...

... Include examples of group processes in the development of understanding, illustrating the nature (and potential advantages) of capitalizing on shared expertise in the classroom....

... measure understanding of the core concepts taught in the lessons. The committee recommends multiple models of teaching the same unit in different school contexts. These could serve several purposes. First, the goal of the videotaped models is to illustrate effective approaches to teaching more ...

... Second, the classroom dynamics and level of preparation of the students can vary significantly from one school to the next. It may be difficult for a teacher to find relevant instruction in a videotape of a class that does not resemble the one in which she or ...

... purposes is itself a research question worth pursuing. Such research should test the effect of each additional model provided on the level of understanding of key learning and teaching concepts, as well as the amount of variation between models that optimizes the flexibility of understanding that ...

... pilot versions of these lessons are designed, the committee recommends rigorous field-testing, with time built into the research plan for revision and retesting. Video-based materials already developed and in use as part of the National Board for Professional Teaching Standards training and ... development process should be considered as possible candidate materials for further study as part of this process....

... The committee recommends that the model lessons be organized in widely accessible video and multimedia libraries that could serve multiple purposes:...

... The lessons could be used as anchors for discussions of pre-service and in-service teachers and administrators, as they try to understand and master the pedagogy to accompany the new forms of learning described in How People Learn....

... The lessons could be instructive in administrative training programs. School administrators responsible for hiring and evaluating teachers need models of good practice that can inform their evaluations....

... &1; With some modified annotations, the lessons could inform parents about teaching techniques that promote learning for understanding. Changing classroom teaching can be problematic if new methods run counter to parents' perceptions of the learning process. The model lessons ... help parents understand the goals of the espoused approach to teaching....

... Extend the Knowledge Base Through Elaboration and Development of Key Research Findings...

... discipline, for the units that are commonly taught in K-12 education. A key finding of the research reviewed in How People Learn is that deep understanding—and the transfer of learning that is one of its hallmarks—requires that the subject matter being taught be tied to the key concepts or ... principles that the discipline uses to understand that subject. The goal of teaching about a given topic is not simply to convey factual information, although that information is a necessary ... of that information as it relates to basic concepts in the discipline, the related analytical methods that answer the question "How do we know," and the terms of discourse in a disciplinary field are all components in developing competence....

... To illustrate, consider the topic of marine mammals as it might be taught in early elementary school. That unit would be likely to include identification of the various marine mammals, information on the features that distin-...

... guish marine mammals from fish, and perhaps more detailed information on the various types and sizes of whales, the relative size of male and female whales, etc. To the marine biologist, this information is the interesting detail in a larger story, which begins with the question: "Why are ... sea?" A unit organized around that question would engross students in an evolutionary tale in which the adaptation of sea creatures for life on the land takes a twist: land mammals now adapt to life in the sea. The core biological concepts of adaptation and natural selection would be at the center of ... tale. Students would come to understand the puzzle that marine mammals posed for scientists: Could sea creatures evolve to mammals that live on land and then evolve again to mammals that return to the sea? They would come to understand the debate in the scientific community and the discovery of ... evidence. And they would have cause to challenge the widespread misconception that evolution is a unidirectional process. The approach of tying information on ... mammals to the concepts, language, and ways of knowing in that branch of science can be used in other areas of science, as well as in other disciplines. But the concepts and organizing ... who are expert in the discipline. The committee recommends that discipline-specific research be conducted in history, mathematics, natural sciences, and social sciences to systematically review units of study that commonly appear in K-12 curricula, specifying the conceptual framework to which the unit ... be tied. The results of this effort will allow teachers and curriculum developers to see if a common conceptual basis exists for separate units of study. Making those underlying concepts explicit helps ... construct a model for understanding that facilitates transfer....

... The committee further recommends that the work in each discipline be reviewed by a panel of disciplinary experts to identify consensus and contested areas. To the extent that there is a high level of agreement within a discipline about the organizing constructs as they apply to units of ... study, the outcome of this research will be highly useful to those who design and evaluate curricula and to those who teach....

... 6. Identifying and addressing preconceptions by field. The research reviewed in How People Learn makes the case that new learning is built on the foundation of existing ... and preconceived notions regarding the subject of study. Learning is enhanced when preconceived understandings are drawn out. When these are accurate, new knowledge can be directly tied to what is already known. And when they are inaccurate, students can...

... be made aware of how their existing conceptions fall short and be provided with more robust alternatives. Teachers and curriculum developers can build learning experiences into curricula that challenge typical misconceptions, and that draw out and work with ... preconceptions. The committee recommends research by discipline and subject area:...

... To identify links that can be made between existing learner understandings and the disciplinary knowledge, when they are compatible;...

... To identify progressive learning sequences that would allow students to bridge naive and mature understandings of the subject matter....

... The research would be conducted independently for mathematics, natural sciences, social sciences, and humanities. The research teams should combine disciplinary experts with cognitive scientists, expert teachers, and curriculum developers. The range ...

...), substantial research has already been done to identify misconceptions. This project should build on those efforts but extend them by developing and testing strategies for working with preconceptions, providing tools and techniques for teachers to work with in the classroom....

... Stage 1 would involve the identification of the subject areas for study and the key concepts that students must comprehend in order to understand each subject area. Assessment tools that allow for a test of comprehension of these concepts, including tests of the degree to which students' ...

... Stage 2 would consist of a review of existing research that explores the preconceptions that students bring to that subject area and an extension of the research into areas that have not been adequately explored....

... Stage 3 would involve the development of learning opportunities and instructional strategies that build on, or challenge, those preconceptions. These might include experiments in physics that produce results ... initial understandings, or research tasks in history that show the same event from multiple perspectives, challenging good-guy/bad-guy stereotyping....

... Stage 4 would involve experimental testing of the newly developed learning tools and instructional strategies, with the assessment tools developed in stage 1 used as a measure of comprehension....

... Develop Tools for Effective Communication of the Principles of Learning as They Apply to Educational Material...

... information on curricula by field. Feedback from workshop participants suggested a high level of frustration with the task of sorting through and evaluating curricula. A central source of information on curricula and their major features would be highly valued. The committee recommends the ... and maintenance of an interactive communications site that provides information about design principles for effective curricula, and relates these principles to particular curricula by subject area. The curriculum review and development recommended above would provide a solid ...

... entirely from the effort to compare and evaluate, then the information available to those who must choose among curricula is diminished. Thousands of schools and teachers must then bear a much heavier burden of information collection....

... from How People Learn includes the extent to which the curriculum draws out preconceptions; whether it includes embedded assessment (both formative and summative); the extent to which it places information in the relevant conceptual framework; the extent to which curriculum modules can be ... in ways that allow teachers to meet particular goals and needs, and the extent to...

... useful information on the curriculum would include the extent and results of field-testing, the length of time it has been in use, the number of schools or school districts that have adopted it, the opportunities for teacher learning, and the amount and kind of support available to teachers using the ...

... will need to represent expert judgments coming from different perspectives, including the subject-matter discipline, master teachers, learning and pedagogy expects, and curriculum developers. Users of an interactive communications site that publishes these judgments can then weigh the expertise ... to select. Ideally, the communications site will make it easy for teachers to access information that is directly relevant to their particular goals and needs....

... Success will also require a growing group of constituencies and experts who can carry forward the principles in How People Learn to evaluating curricula....

... Research on Pre-Service and In-Service Education...

... The research and development proposed in this section is designed, once again, to achieve three goals: (a) to look first at existing practice through the lens of How ... Learn, (b) to advance understanding in ways that would facilitate alignment of teacher preparation with principles of learning, and (c) to make the findings of this research more widely accessible and easily understood. The recommended research is described in seven project areas....

... Examine Existing Practice Through the Lens of How People Learn...

... 8. Review the structure and practices of teacher education for alignment with the principles of learning. For teacher education and professional development programs to be aligned with the principle of...

... learning, they need to prepare teachers to think about the enterprise of teaching as building on the existing knowledge base and preconceptions of their students, to teach skills for drawing out and working with existing understandings, and to continually assess the progress of ... toward the goal of deep understanding. The programs need to provide for their student the opportunity to develop a deep understanding themselves of the subject matter they will teach and the ability to facilitate students' transfer of knowledge to related areas. They need to ... teachers to be aware of and directly teach metacognitive skills. And they need to convey a model of the teacher as learner, who continually develops expertise that is flexible and adaptive....

... These are implications for what schools of education and professional development programs should reach. But the students in those programs will themselves learn more effectively if they ... taught according to these principles. How People Learn therefore has implications for how schools of education do their job. Do those schools have program structures and practices that reflect the principles of learning discussed here?...

... The committee recommends that evaluation research be conducted to examine current program structures and practices at schools of education through the lens of How People Learn. This effort should not only synthesize what is already known about teacher training programs, but ... undertake a new evaluation. The sample of schools should be chosen to reflect the wide range of program formats (which currently include undergraduate and postbaccalaureate program designs), as well ...

... 9. Review professional development programs for alignment with the Principles of learning and for relative effectiveness in changing teaching practice. The issue of teacher preparedness is rapidly becoming one of intense focus in policy arenas....

... are an important policy tool available to concerned lawmakers. But there are vastly different models of professional development, and relatively little is known about the amount and type that is required to significantly change teacher performance and student achievement. Existing ... efforts along these lines need to be extended and built on....

.... Features that promote, or conflict with the principles should be highlighted. The research should also examine the effects of alternative types, and amounts, of professional development training on teacher performance and student achievement. As envisioned, the research would:...

... Define a small set of common models of professional development. These should include individual workshops, more lengthy in-service programs, and university courses. They should include training that is tied to a specific curriculum, as well as training in teaching techniques....

... Review the features of those programs that do and do not support learning, including the opportunities they provide for exploring teachers' preconceptions, for assessing what teachers am learning as ... go along, and for teachers to provide feedback and receive ongoing support as they attempt to use what they have learned in the classroom environment....

... Define measures of teacher knowledge and performance that would be expected to change as a result of the learning opportunity....

... Estimate the effect of quantity and type of training on teacher performance and student achievement....

... The envisioned research would require a major data collection effort. Success is likely to require that researchers work closely with school districts over a multiyear period. In states or school districts that are about to undergo an expansion in professional development spending, ...

... provide professional development programs the results should provide feedback that allows for improvement in program design; (b) for administrators and policy makers the results should provide guidance in evaluating professional development programs; and (c) for researchers, the results should be ...

... 10. Explore the efficacy of various types of professional development activities for school administrators. School administrators at the individual school and school district level am responsible for facilitating teacher learning and evaluating teacher performance. If they are to support teachers' ...

... The committee recommends that research be conducted to identify the amount and type of professional development needed to create in administrators an ability to differentiate between teaching practices that do, and do not, ... development opportunity effectively changes administrators' evaluation of teacher performance. It should vary the amount of such training and the model through which training is provided (intensive workshops, monthly seminars conducted over the course of a year, etc.). Measures of ... ' interpretations of teaching should be taken prior to training, at the point of program completion, and again a year after completion in order to ascertain the sustainability of change over time and the effect of prior beliefs on post-training ...

... Extend the Knowledge Base Through Elaboration and Development of Key Research Findings...

... regarding the process of learning. Adults, well as children, have preconceptions that contribute to the ways in which they make sense of ideas and evidence and the decisions they make in undertaking tasks. For teachers to think about and conduct their teaching differently, they need to learn, ...

... Research be conducted that explores the prior conceptions and beliefs of teachers and those learning to become teachers, identifying the common pedagogical models that current and prospective teachers use;...

... Learning opportunities be developed that challenge misconceptions about how people learn and support the development of a new model that is based on learning research;...

... Evaluations should be conducted of the effectiveness of those learning opportunities in changing understanding and conceptions of practice....

... preconceptions about learning, as well as tested techniques for working with those preconceptions that could be incorporated into the curricula of schools of education and professional development programs....

... 12. Conduct discipline-specific research on the level and type of education required for teaching that discipline in elementary, middle, and high school. How People Learn makes clear that to teach effectively in any discipline, the teacher must link the information being taught to the key organizing ...

... that discipline-specific research be conducted on the amount and type of training in content knowledge that teachers need for various levels of schooling (elementary, middle, high) in order to teach for understanding. The challenge in providing such training is to equip the future teacher with both ... of this dual requirement, is content knowledge best obtained in disciplinary courses that also service majors in the discipline, or in courses in schools of education, or in jointly sponsored courses that emphasize effective teaching of the content of the discipline? When content and teaching methods ...

... The committee recommends further that the discipline-specific research teams evaluate existing tools for assessing teachers' content knowledge and of discipline-specific developmental trajectories and make recommendations regarding their adequacy....

... Develop Tools for Effective Communication of the Principles of Learning to Teacher Education...

... fields in which scientific principles must be put to work, laboratory experiences provide the opportunity to experiment with applications of general and specific...

... principles. The expense of the laboratories is justified by the qualitatively different experience made possible when the boundaries of an idea can be tested or worked with in a laboratory or field-based setting....

... To prepare students in schools of education to put to work the scientific principles of how people learn, laboratory experience could provide the opportunity to test the ...

... classroom experience an so overwhelm a teacher that what was learned in a preparatory program can quickly be cast aside. Norms of operating in a school can quickly be adopted as survival techniques, however divergent those norms and the principles of learning might be. Laboratory experience could ... diagnosis of events that are likely to arise in the classroom, that could ease the transition into the classroom and allow for greater transfer of school-based learning to the practice of teaching....

... teaching practice. The laboratories would need to develop ongoing relationships with a body of students to be taught (e.g., partnerships with local schools or Saturday classes). How this relationship would be established and maintained should be given careful attention in the design proposal for such a ...

... the ability to conduct formative assessment techniques. A theme that has coursed through this report is that teachers must be able to draw out and work with students' preconception and assess their progress toward understanding. The laboratory could provide opportunities to develop those ...

... The lab, as envisioned, would not provide a teaching internship or serve the function of a professional development school. Rather, it would provide an opportunity for beginning teachers to experiment with the principles of learning that are relevant to teaching practice. ...

... diate demands of the classroom do not prevent reflection on, or exploration of, the process of learning. Exercises could be developed for laboratory use that ... science findings of relevance to teaching, including findings on memory, the organization of information, the use of metacognitive strategies, and retrieval of knowledge when transfer is prompted and when it is not. In addition to creating a deeper appreciation of the science of learning, these ... would invite teachers to think of themselves as scientists, to observe and reflect on learning as a scientist would. To the extent that those skills transfer to the classroom, the goal of continuous learning and reflection ...

... The laboratories would also serve as a locus of information for teachers in training, for practicing teachers in the community, and for researchers in the learning sciences. ''Protocol materials," or materials for diagnosis and interpretation, could be housed here. These might ... model lessons or units (project area 4) that could be incorporated into the teaching of diagnostic and interpretive competencies. They might also include protocols of student creativity in scientific thinking, insight, reasoning like a novice versus an ... in a task, failure to transfer, negative transfer, distributed cognition, using parental stores of knowledge in a class, concrete and operational thinking, and inferring causation. These protocols, then, provide vivid cases and examples that instantiate concepts relevant to teaching ... learning. Videotaped lessons of teaching in other countries produced by the Third International Mathematics and Science Study project might also be made available. Faculty-directed course projects could develop evaluations of curricula in terms of the ... of learning and submit them to the interactive communications site described above (project area 7) for broad use....

... communities of teachers and researchers via the Internet could also be explored. Students graduating from these programs will then carry to the schools in which they teach an ability to be connected to outside communities with relevant knowledge that is not now a feature in many school districts....

... 14. Develop tools for in-service education that communicate the principles of learning in How People Learn. For the principles of learn-...

... very busy audience. The challenge of developing ways to effectively communicate to those teachers is a central one. The committee recommends research and development that distills the messages of How People Learn for teachers and develops examples that are relevant to the classroom context. These ... should be communicated in a variety of formats, including text, audiotapes, videotapes, CD-ROMS, and Internet-based resources....

... Researchers should design and study the effectiveness of the different media in communicating key ideas, as well as the satisfaction of teachers with the various media and the ... should focus on the format of the material as well. For example, case-like stories could be compared with more didactic methods often used in texts and lectures....

..., and the preparation of those who undertake the daunting task of classroom teaching. Yet How People Learn is not a blueprint for redesigning schools....

... is before them, this focus can be easily understood. But just as a doctor who recommends a healthy diet, stress reduction, exercise, adequate rest, and a personal support system cannot say which is most critical to health, researchers cannot identify the most critical change in the education system. ...

... And just as the exercise requirement has no single attached cost—it can be met by a run through the park or an indoor tennis game at a posh racket ... —teaching for understanding has no obvious price tag attached. Eliciting and working with student ideas and preconceptions will be easier in a small class than in a larger one, just as exercise in a sports club will be easier in inclement weather. But with ... for a sustained period of time rather than dictate the method for achieving the goal. Similarly, we focus on the principles of teaching for understanding with the recognition that, in the...

... diverse landscape of schooling, the manifestations of those principles will vary. This does not diminish what is known with certainty: teaching for understanding is a clear goal ...

... programs, for example, will be of use to policy makers who set requirements for receiving funds for that purpose. At the urging of both policy makers and educators who participated in the workshop, we propose further research to review standards and assessments at the state level, and to examine ... certification requirements at both the state and national level....

... to identify the policies that appear to facilitate or impede the adoption and expansion of new teaching practices, we propose case study research on schools and school districts that have successfully implemented reform. Although we don't envision a blueprint, there may be organizational features, ... policies, or incentive structures in these schools that create an environment conducive to change....

... State Standards and Assessments...

... tools used to measure compliance through the lens of How People Learn. Forty-nine states now have a set duration standards that apply to their schools, and most have or are developing assessments tools to hold school districts accountable for implementation. Standards vary considerably in the ...

... To identify features of standards that support and violate the principles of learning in How People Learn;...

... To evaluate the alignment of desirable features in a state's standards with the assessment tools used for measuring compliance;...

... To evaluate the features of compliance assessments that support and conflict with the principles of learning;...

... To identify incentives and penalties that support the goal of effective education and those that appear to undermine that goal....

... Learn and that can be used by states for accountability purposes. Tests of student achievement that can be widely and uniformly administered across schools are the key mechanism by which policy makers hold schools accountable. How People Learn has clear implications for the measurement of student ...

... Conventional psychological and educational testing is an outgrowth of theories of ability and intelligence that were current at the beginning of the century. Psychometrics has become increasingly sophisticated in its measurements; yet it does ... attempt to look inside the "black box" of the mind. Now that the newer sciences of cognition and development have transformed our understanding of learning and the development of expertise, measurement theory and practice need fundamental rethinking. There is much in the traditional ... that is valuable, including a focus on objectivity and reliability of measurement. There is a problem, however, with what is being measured....

... As a first step in the process of rethinking educational testing, the committee recommends that assessment tools be designed and tested with the goal of measuring deep understanding as well as the acquisition of factual knowledge. This is both a modest beginning and a ... task. To be useful for policy purposes, these assessments should be in a form that can be administered widely and scored objectively and that meets reasonable standards of validity and reliability. These requirements can be at odds with the measurement of deep understanding, at least ... the current state of the art. But it is important to begin finding solutions that, for example, minimize the trade-off between assessing for understanding and scoring objectively. A variety of experiments is needed, both with new forms of standardized tests (including computer-based instruments that ... "virtual" experiments), and with alternative assessments (such as portfolios) that have become more popular in recent years....

... How alternative assessment measures might be combined to offer a balanced view of achievement....

... 17. Review teacher certification and recertification requirements. Currently, 42 of the 50 states assess teachers as part of the certification and licensure process. But states vary enormously in the criteria used and the amount and type of assessment they require. The federal government also ... provided support for an assessment process for advanced certification that is developed and administered by the National Board for Professional Teaching Standards. The committee recommends that research be conducted to review the ... types of assessments currently in use across the continuum of teacher development, from initial licensure to advanced status. This would include standardized tests, performance-based assessments under development (Interstate New Teacher Assessment and Support Consortium), and the National Board ...

... The features of certification that are aligned with the principles of How People Learn and those that are in conflict....

... To the extent that data are available, the relationship between certification and increases in student learning....

..., strategies to reform certification processes so that they provide better signals of a teacher's preparedness for the task of teaching for understanding....

... 18. Conduct case study research of successful "scaling-up" of new curricula. School districts set a variety of policies that influence the environment in which teachers operate. Even when a new curriculum is pilot-tested with ... results, it can be very difficult to extend that curriculum into other schools in the district, sometimes even to other classrooms in the same school. The committee recommends case study research of successful scaling-up efforts to determine which district-level and school-level policies ...

... How much scheduled time do teachers have in their work day that is not in the classroom and that can be used for reflection, study, or discussion with other teachers?...

... How much training was offered to teachers who adopted the new curriculum? Is there ongoing support for the teacher who has questions during ...

... Is there a community within the school, or extending beyond the school, that provides support, feedback, and an opportunity for discussion among teachers? Existing research suggests that the development of a professional ... as part of the school culture is one of the most important determinants of successful school restructuring to implement a more demanding curriculum (Elmore, 1995; Elmore and Burney, 1996). These studies should focus on the features that hold ...

... Did the school attempt to involve parents and other community stakeholders in the change?...

... to extend the knowledge base in this area should be coupled with an effort to synthesize the research results, making them easily accessible to school communities interested in reform....

... Develop Tools for Effective Communication of the Principles in How People Learn to Policy Makers...

... on the effective communication of research results to policy makers. Policy makers do not routinely look to research as a source of information and ideas. But there are windows of opportunity for research in policy making. Researchers who study this issue suggest that the windows are more likely ... open during crises, when issues are new and policy makers have not yet taken a position, or when issues have been fought to a stalemate. When those opportunities arise, information must be ...

... Assess preconceptions of education policy makers regarding the goals of K-12 education and the strategies for achieving those goals. Are they consistent with the principles of learning in How People Learn...

... Identify examples that engage the preconceptions of policy makers (if those preconceptions diverge from research findings on how people learn) and test their effectiveness at changing the initial understanding....

... Identify methods of communication that are most likely to reach, and teach, policy makers....

... Compare the effectiveness of alternative approaches, including concisely written materials, personal contact, and briefings or seminars....

... The product of this research should be both a report of the findings regarding how policy makers learn most effectively and concisely written material that can be used for communicating effectively to policy makers....

... Public Opinion And The Media...

... in two ways. First, to the extent that the public is aware of the implications of learning research for classroom practice, teachers, administrators, and policy makers will receive more support for the types of changes that How People Learn suggests. Second, many teachers, administrators, and policy ... popular media. As we heard from participants in the workshops, How People Learn is not a document that is likely to be widely read by educators and policy makers. Information presented in a more popular format will have far better prospects of reaching this audience....

... 20. Write a popular version of How People Learn for parents and the public. Everyone has preconceptions regarding the process of learning and effective methods of education. Those theories are put to work on a daily basis when we model behaviors for children, provide instructions to ...

... The translations of these experience-based models to the evaluation of classroom teaching can lead to expectations that conflict with the principles of learning drawn from research. A ...

... numbers, rather than instructing the child to line those numbers in columns and add the columns in turn. The importance of grappling with the problem and searching for a solution method, and the appreciation that such grappling ...

... relevant to parents' observations of children at a variety of ages. And it should help parents who are interested in understanding or evaluating a school formulate questions and make observations....

... Some particularly effective example and their implications for teaching should be highlighted in a manner that makes them easy to extract from the text. The children's book, Fish is Fish by ... Lionni (1970) mentioned in How People Learn, can serve as an effective example. In the story, a frog adventures onto the land and comes back to describe what it saw. The fish who listen to the frog imagine each description to be an adaptation of a fish: humans are imagined to ...

... Beyond How People Learn...

... The research and development agenda proposed thus far focuses on the question that the Office of Educational Research and Improvement posed to the committee: How can the insights from How People Learn be incorporated into educational practice? How People Learn reviews a ...

... committee proposes three research projects that hold promise for advancing the understanding of learning in ways that will be useful for educational practice....

... 21. Investigate successful and creative educational practice. There are well-known cases of exceptional teaching by educators who, often without the help of educational researchers, ... have created innovative and successful classrooms, programs, curricula, and teaching techniques. The committee recommends that case study research be conducted to investigate the principles of learning underlie successful ... experiments. The conceptual framework provided by How People Learn can be employed as a lens through which that practice can be viewed, and such case studies could challenge and inform the science of learning....

... benefits: it would ground in sound theory innovations that often exist in isolation, that often cannot be evaluated well by traditional methods, and that cannot be explained well to others. This research could contribute an understanding of why the innovations work, perhaps leading to improvements ... , it may stimulate researchers to pursue new theoretical questions regarding cognition. In innovative classrooms, students may engage in forms and levels of learning that are not anticipated by current cognitive theory. From studying such classrooms and the learning that takes place in them, ...

... 22. Investigate the potential benefits of collaborative learning in the classroom and the design challenges that it imposes. Outside the classroom, much learning and problem solving takes place as individuals engage with each other, ... of those with skills and expertise, and use resources and tools that are available in the surrounding environment. The benefits of this "distributed cognition" are tapped inside the classroom when students ... collaboratively on problems or projects, learning from each others' insights, and clarifying their own thinking through articulation and argument (Vye et al., 1998a). Some research indicates that group problem solving is superior to individual problem solving (e.g., Evans 1989; ... and Evans, 1995), and that developmental changes in cognition can be generated from peer argumentation (Goldman, 1994; Habermas, 1990; Kuhn, 1991; Moshman, 1995a, 1995b; ... and Zeitz, 1995; Youniss and Damon, 1992), and peer interaction (Dimant and Bearison, 1991, Kobayashi, 1994). For these reasons, the community-centered classroom described in Chapter 2, in which students learn from each other,...

... drawbacks for learning as well, particularly in the early grades. Societal stereotypes or classroom reputations can determine who takes the lead, and whose ideas are respected or dismissed. Differences in temperament can produce consistent leaders and followers. Group products can advance each ... ' understanding of a problem, or they can mask a lack of understanding by some....

... The committee recommends that research be conducted by teams of cognitive scientists, development psychologists, curriculum developers, and teachers to investigate the potential benefits of collaborative learning in the classroom and the problems that must be addressed to make it ... for all students. The research should explore and field-test alternative design strategies. The results should be presented both as scholarly research, and as a discussion addressed to teachers who ...

... 23. Investigate the interaction between cognitive competence and motivational factors. Much of the research on learning has been conducted outside the classroom. Inside the classroom, issues of cognitive competence ... intertwined with issues of motivation to perform. The challenges of learning for today's world require disciplined study and problem solving from the earliest grades. To meet the challenges, learners must be motivated to pay attention, complete assignments, and engage in ...

... Although cognitive psychologists have long posited a relationship between learning and motivation, they have paid little attention to the latter, despite its vital interest to teachers. Research has been done on motivation, but there is ...

... The committee recommends that research be conducted to elucidate how student interests, identities, self-knowledge, self-regulation, and emotion interact with cognitive competence. This research should combine the efforts of social and developmental psychologists with those of ... psychologists. A variety of approaches should be considered, including case studies of small numbers of individual children and the study of the classroom practice of teachers with reputations for promoting achievement among average students, as well as those at high risk for ...

... 24. Investigate the relationship between the organization and representation of knowledge and the purpose of learning that knowledge. Research in cognitive science suggests that knowledge is organized...

... differently depending on the uses that need to be made of it. In other words, the structure of knowledge and memory and the conditions under which it is retrieved for application evolves to fit the uses to which it is put. Similarly, what counts as understanding will ... in terms of means, rather than as an end in itself. Just as there is no perfect map, but only maps that are useful for particular kinds of tasks and answering particular kinds of questions, there is no perfect state of understanding, but only knowledge organizations that are more or less useful ... particular kinds of tasks and questions....

... This empirical insight has profound implications for the organization of education, teacher education, and curriculum development. The committee recommends research to deepen understanding of the kinds of knowledge organizations that will best support ... kinds of activities. For example, the kinds of biology needed to know how to take care of plants (e.g., knowing when, where, and how to plant them in different climates and soil conditions) differs from the knowledge necessary to genetically engineer them....

... the nature of the content knowledge that teachers need in order to teach various disciplines. For example, the most useful knowledge for a middle school mathematics teacher may not come from taking a higher-level course in a traditional mathematics sequence, particularly if that course was designed ...

... These considerations are also important for curriculum. Research investigations could yield better understanding for guiding curriculum design so that the knowledge that learners develop from their experiences in courses will be better retrieved in ...

... one considers the complexity of the ways in which research influences practice (as depicted in Figure 1.1), the heterogeneous audiences for research and their very different needs become apparent. As we have noted throughout this report, the ways in which the principles of learning depicted in How ... Learn will be incorporated into practice raise unique problems for pre-service and in-service education, for educational materials, for policy, and for the public (including the media). The pathways by which research knowledge travels, and the transformations it must undertake for each of these ... challenges for communications design. To be effective, such communications cannot serve merely as disseminations of research knowledge. Translating and elaborating that knowledge for each audience has been a theme throughout the agenda. In this final section, we propose an effort to make these ...

... 25. Design and evaluate ways to easily access the cumulative knowledge base. Adaptive communications about the science of learning are very much needed that can ... needs of the various education audiences for knowledge derived from research. For such conversations to occur between the research communities and these diverse constituencies, experimentation with Internet-based communications forums is needed....

... The Internet is becoming a social place for the formation and ongoing activities of distributed communities, not only a digital library for browsing and downloading information. Current electronic communities ... tens of thousands of members share information and convene around a broad range of topics. High-quality resources on the science of learning will be needed to spur on-line discussions among the ... they are designed to serve, and to invite suggestions about how communications concerning the science of learning can better fit the needs of those who will use their results (Pea, ...

... The committee recommends the development and continuous improvement of a national communications forum for research knowledge on learning and teaching. This new media communications form would be accessible through the Internet and would provide illustrative cases and usable information ... both the research depicted in How People Learn and new...

... continue to emerge in ongoing research. It would provide opportunities for different contributors who are stakeholders in education to post messages and raw the usefulness of documents and materials. Experimentation is needed in establishing ''virtual places" online where diverse group could convene ... reflect on how these research advances could be incorporated to improve the practices of education and learning. Such a "learning improvement portal" would provide a vital national resource, guiding research-informed improvements of education....

... research efforts that we have proposed make a serious effort to combine strengths of the research community with he insights gained from the wisdom and challenges of classroom practice. Our suggestions for research do not assume that basic research should first be conducted in isolation and then ... down to practitioners. Instead, we propose that researchers and practitioners work together to identify important problems of inquiry and define the kinds of research and communication strategies that would be most helpful to both groups....

... Because of our emphasis on bridging research and practice, many of the efforts that we have proposed here are nontraditional. They combine research and development, rather than undertaking the two separately. It is the committee's view that such combined efforts are most likely to focus the attention ... researcher on problems that are central to education, and they are more likely to ensure rigor and consistency with the principles of learning in the programs and products that are developed....

... Moreover, many of the efforts combine research and communication. Often, the two are considered separate domains. But the goal of communication is learning, and How People Learn provides guidance for ... communication. For each audience, preconceived understandings must be identified and addressed in the effort to communicate. And examples that situate ideas in experiences relevant for that audience are crucial....

... the proposed projects will be challenging. There are still relatively few arenas in which researchers work as partners with teachers, administrators, and communications developers (who might film model lessons, develop web sites, produce brochures, etc.). But to be effective, systematic efforts to ... education will require that more of these partnerships be forged. Research and development grants that reward existing partnerships and encourage new ones to be formed could provide a much-needed impetus....

... And finally, the agenda proposed is expansive. Many of the recommended projects are time-intensive, multiyear efforts. The nation's decentralized ... . To don the lens of How People Learn to evaluate the various facets of that system is in itself a daunting task. We propose further the development and testing of new classroom teaching tools, techniques of teacher and administrator training, further research on human learning, and applications of ... that could provide dynamic mechanisms for bringing advances in how people learn and how people teach into continual cycles of coordination and improvement. From the committee's perspective, the integration of these efforts holds the potential to bring research and practice together in the ...