National Academies Press: OpenBook

Transforming EPA Science to Meet Today's and Tomorrow's Challenges (2023)

Chapter: Appendix D: Biotechnology

« Previous: Appendix C: Monitoring for Exposure
Suggested Citation:"Appendix D: Biotechnology." National Academies of Sciences, Engineering, and Medicine. 2023. Transforming EPA Science to Meet Today's and Tomorrow's Challenges. Washington, DC: The National Academies Press. doi: 10.17226/26602.
×

Appendix D
Biotechnology

For the purposes of this discussion, we consider “biotechnology” to refer to methods, products, and processes other than selective breeding and sexually crossing organisms to endow new characteristics in organisms. NASEM (2017) defines biotechnology products as

products developed through genetic engineering [(sometimes referred to as genome engineering)] (including products where the engineered DNA molecule is itself the “product,” as in an engineered molecule used as a DNA information-storage medium) or the targeted or in vitro manipulation of genetic information of organisms, including plants, animals, and microbes. The term also covers some products produced by such plants, animals, microbes, and cell-free systems or products derived from all of the above. (NASEM, 2017, p. 16)

Biotechnologies are anticipated to play a crucial role in biomanufacturing, which utilizes biological systems to produce commercially important biomolecules for use in the agricultural, food, material, energy, and pharmaceutical industries (Zhang et al., 2017). Recent federal initiatives in this area include the 2022 White House Executive Order 14081, Advancing Biotechnology and Biomanufacturing Innovation for a Sustainable, Safe, and Secure American Bioeconomy (Biden, 2022), the Defense Advanced Research Projects Agency’s (DARPA’s) Living Foundries program (Cheever, 2021), and the recent U.S. Department of Defense (DoD)-sponsored -sponsored BioMADE initiative.1 The DARPA Living Foundries program was developed to create a revolutionary, biologically based manufacturing platform to provide new materials, capabilities, and manufacturing paradigms for the DoD and the nation and seeks to develop the tools, technologies, and methodologies to transform biology into an engineering practice, speeding the biological design–build–test cycle and expanding the complexity of systems that can be engineered. In 2021, DoD sponsored BioMADE, a new manufacturing innovation institute to “enable domestic bioindustrial manufacturing at all scales, develop technologies to enhance U.S. bioindustrial competitiveness, de-risk investment in relevant infrastructure, and expand the biomanufacturing workforce to realize the economic promise of industrial biotechnology.”2

Increasingly, biotechnology applications are being designed to operate within the environment, some of which are also intended to spread or persist in those environments. These applications span agriculture, environmental remediation, climate mitigation, public health, and disease vector control. Some applications may fall within the U.S. Environmental Protection Agency’s (EPA’s) regulatory purview and at the same time could be used for EPA’s role in environmental protection, such as waste site remediation, creating a situation where a particular tool is both regulated and used by EPA.

REGULATION

EPA and the U.S. Department of Agriculture (USDA), and the U.S. Food and Drug Administration (FDA) have shared responsibility for regulating biotechnology in the United States. The 2017 Update to the Coordinated Framework indicates which agencies have responsibility for which types of biotechnology products (USEOP, 2017, p. 1). EPA is responsible for biotechnology products that have insecticidal, fungicidal, rodenticidal, or other toxic properties. The agency also has authority over new chemicals in

___________________

1 See https://biomade.org.

2 See https://biomade.org.

Suggested Citation:"Appendix D: Biotechnology." National Academies of Sciences, Engineering, and Medicine. 2023. Transforming EPA Science to Meet Today's and Tomorrow's Challenges. Washington, DC: The National Academies Press. doi: 10.17226/26602.
×

commerce, which includes certain forms of genetically engineered organisms. The regulatory responsibilities include premarket testing and monitoring product performance.

Section 10402 of the CHIPS and Science Act of 2022 (P.L. 117-167) establishes a National Engineering Biology Research and Development Initiative to advance “engineering biology research; support risk research to address ethical, safety, security and other societal implications of engineering biology,” among other objectives. As part of the initiative, EPA is called on to “support research on how products, processes, and systems of engineering biology will affect or can protect the environment.” In addition, the 2022 White House Executive Order 14081, calls on EPA, USDA, and FDA to identify areas of ambiguity, gaps, or uncertainties in the Coordinated Framework by engaging with developers and external stakeholders, and through horizon scanning for novel products of biotechnology (Biden, 2022).

While many applications of biotechnology have a clear regulatory path through EPA, others raise questions as to which regulatory agency has the jurisdiction, as well as the proper scientific and public engagement expertise and resources to conduct risk assessments associated with such applications. As evident in the nearly 10-year debates in Key West, Florida, over the release of a genetically engineered mosquito, conducting a risk assessment without thorough public engagement can lead to public mistrust in the decision-making process for the approval of new tools or technologies (White, 2021).

Other new products will continue to pose challenges because the regulatory agencies do not have data points to which the new products can be easily compared. The potential use of gene drives provides one example.

A gene drive is a system of biasing inheritance to increase the likelihood of passing on a modified gene. Offspring inherit one copy of each gene from each parent. Normally, this limits the total incidence of mutations over generations. Gene-drive components cause the modified DNA to copy itself into the DNA from the unmodified parent. The result is a preferential increase in a specific trait from one generation to the next and, in time, possibly throughout the population. Gene drives have been suggested as a way to eliminate or reduce the transmission of disease, eradicate invasive species, or reverse pesticide resistance in agriculture (Gallo et al., 2018). The potential ability for gene drives to self-propagate has raised ecological and broader societal concerns, along with debates over how to govern such applications both domestically and internationally (Connolly et al., 2022; NASEM, 2016; Oye et al., 2014; Redford et al., 2019).

The development of gene drives has raised questions as to whether those funding the applications should also fund and develop guidelines for potential field trials; specifically, the National Institutes of Health (NIH, 2021) and DARPA. For example, in 2017, DARPA announced plans to award ~$65 million in contracts for its Safe Genes program. For comparison, in the face of its budgetary constraints (see Chapter 2), in July 2021, EPA’s Office of Research and Development (ORD) awarded $3,041,583 to five institutions to develop science-based approaches to evaluate the potential human health and environmental impacts of new biotechnology products.3 In addition, in May 2020, ORD issued a request for applications (RFA), as part of its Science to Achieve Results (STAR) program, for research funding to support the development of improved human health and environmental risk assessments of new biotechnology products, including chemicals; pesticides; and genetically modified microorganisms used in chemical production, microbial fuel cells, mining and resource extraction, building materials, waste remediation and pollution control, and nonpesticidal agriculture applications (e.g., biofertilizers, weather and climate modification; EPA, 2020).

IDENTIFICATION OF GENETICALLY MODIFIED MICROORGANISMS AND THEIR GENE PRODUCTS IN THE OPEN ENVIRONMENT

The design, mutation, introduction, and deletion of genes in developing genetically modified organisms (GMOs) requires an adduct to differentiate it from the parent or host strain, usually in the form of selectable antibiotic-resistant genes. For example, deletion of genetic elements on the chromosome may have kanamycin resistance associated with the modification, whereas introduction of plasmid-based

___________________

3 See https://cfpub.epa.gov/ncer_abstracts/index.cfm/fuseaction/recipients.display/rfa_id/663#.

Suggested Citation:"Appendix D: Biotechnology." National Academies of Sciences, Engineering, and Medicine. 2023. Transforming EPA Science to Meet Today's and Tomorrow's Challenges. Washington, DC: The National Academies Press. doi: 10.17226/26602.
×

transformations will also have ampicillin resistance encoded. Concern arises if the GMO modification transfers to other microbiota in the environment, if the mutant strain overtakes the native population during the specific biotech application, or if the strain loses the introduced gene. Hence, there is a need to identify the genetic profile (host strain, modification, resistance gene) of an introduced, intact cell in the environment.

Molecular methods for detection of plasmids, gene products, and microbial populations are standard and routinely used. Quantitative polymerase chain reaction technology can be used to analyze the nucleic acid extracts from total, genomic, or plasmid DNA for quantifying gene copies or to analyze genetic variations in specific genomic regions and verify the presence of a modified gene. Sequencing the genes for16S ribosomal RNA (rRNA) provides species-level identification of microbial populations and thus the host strain. This technique is based on the detection of sequence differences in the highly variable regions of the 16S rRNA gene which is present in all bacteria.

Because microbes are abundant and varied in environmental samples, high-throughput sequencing, also referred to as next-generation sequencing (NGS), is used to determine the sequence of entire genomes or targeted regions of DNA or RNA by sequencing up to 100 billion reads of DNA fragments (150-300 base pairs) per run. This high-capacity approach is useful in metagenomics, in which the entire DNA extracted from an environmental sample is sequenced and aligned to a reference database, allowing gene identification and producing relative gene counts per sample. The totality of information generated by these methods can identify the presence of GMOs in a mixed soil or water sample, along with other bacteria and their genes.

However, there are analytical limitations to NGS. To verify that the mutation is associated with its host strain, selective antibiotic culturing of microorganisms from the sample is required, followed by 16S rDNA and plasmid or genomic sequencing. This time-consuming step reduces the number of isolates that can be processed. Furthermore, the read length of 16S sequencing limits the ability to make definitive taxonomic assignments during bioinformatics processing. To resolve base differences at the species or strain level, longer reads not offered by NGS of the 16S regions are needed.

Two approaches have been used to improve sequencing read length and whole-cell genomic contents. Single-molecule sequencing (Eid et al., 2009) can read up to several thousand base pairs of nucleotides directly from biological samples with high accuracy, but with fewer analytical steps than with traditional NGS. This technology was used to commercialize sequencing platforms and has many applications in biotechnology, microbial surveillance, and detection of genetic polymorphisms. The upgrade of NGS to longer sequence reads via single-molecule sequencing will vastly improve resolution and output.

Single-cell sequencing examines information from individual cells, providing a higher resolution of cellular differences than with traditional sequencing technology (Nawy, 2014; Shapiro et al., 2013; Tang et al., 2019; Wang and Navin, 2015). The technique has applications in health monitoring, genomics, and transcriptomics. However, methods to sequence a single strain’s 16S rDNA, chromosome, and plasmid have yet to be developed, but, when available, the methods will enable detection of GMOs in a mixed consortia collected from the environment.

ORD EXPERTISE

The expertise to make use of sequencing technologies exists within ORD. For example, ORD researchers have been using DNA metagenomic sequencing techniques to identify microorganisms in water as a means of identifying pathogens and other bacteria in environmental media (Annavajhalla et al., 2018). In addition, ORD researchers have recently published on the use of RNA sequencing as a means of screening biological responses to chemicals as a high-throughput method for predictive toxicology (Harrill et al., 2018). This expertise, coupled with informatics expertise, has already been applied in various aspects of prioritization, risk assessment, and regulation.

Maintaining expertise within EPA in emerging biotechnologies will be important. EPA has made some investments in this space. In 2012, EPA’s Office of Pollution Prevention and Toxics held a workshop in partnership with the Woodrow Wilson Center and the Massachusetts Institute of Technology Program

Suggested Citation:"Appendix D: Biotechnology." National Academies of Sciences, Engineering, and Medicine. 2023. Transforming EPA Science to Meet Today's and Tomorrow's Challenges. Washington, DC: The National Academies Press. doi: 10.17226/26602.
×

on Emerging Technologies. The workshop convened experts from academia, industry, government agencies, and nongovernmental organizations to develop a scientific understanding of the ecological issues that have the greatest relevance for evaluating synthetically designed organisms. Participants considered data needs and testing methods for assessing the safety of a field release of synthetically designed algae for biofuel production. EPA held a workshop in July 2021 to identify specific research needs related to the uncertain risks of emerging biotechnologies based on input from the EPA Office of Pollution Prevention and Toxics, Office of Pesticide Programs, ORD, and voluntary perspectives offered by Biotech STAR grant awardees and outside experts.

Other information-gathering activities could be useful for ORD to build on those previous workshops. Periodic horizon-scanning activities focused specifically on emerging biotechnologies are another valuable information-gathering activity, which could include research being conducted at other agencies as well as the private sector. A recent horizon scan (Kemp et al., 2020) identified 20 topics including the regulation of genomic data, increased philanthropic funding, malicious uses of neurochemicals, and environmental applications such as crops for changing climates and agricultural gene drives (see Table D-1).

TABLE D-1 Issues Identified Through a Bioengineering Horizon Scan in 2020

<5 Years 5–10 Years >10 Years
Access to biotechnology through outsourcing Agricultural gene drives Bio-based production of materials
Crops for changing climates Neuronal probes expanding new sensory capabilities Live plant dispensers of chemical signals
Function-based design in protein engineering Distributed pharmaceutical development and manufacturing Malicious use of advanced neurochemistry
Philanthropy shapes bioscience research agendas Genetically engineered phage therapy Enhancing carbon sequestration
State and international regulation of DNA database use Human genomics converging with computing technologies Porcine bioengineered replacement organs
Microbiome engineering in agriculture Governance of cognitive enhancement
Phytoremediation of contaminated soils
Production of edible vaccines in plants
Rise of personalized medicine such as cell therapies

NOTE: Issues are grouped according to likely timeline for realization.

SOURCE: Kemp et al., 2020. Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0).

REFERENCES

Annavajhalla, M. K., V. Kapoor, J. Santo-Domingo, and K. Chandran. 2018. Comammox functionality identified in diverse engineered biological wastewater treatment systems. Environmental Science & Technology Letters 5(2):110-116. https://doi.org/10.1021/acs.estlett.7b00577.

Biden, J. R., Jr. 2022. Executive Order 14801: Advancing Biotechnology and Biomanufacturing Innovation for a Sustainable, Safe, and Secure American Bioeconomy. https://www.whitehouse.gov/briefing-room/presidential-actions/2022/09/12/executive-order-on-advancing-biotechnology-and-biomanufacturing-innovation-for-a-sustainable-safe-and-secure-american-bioeconomy.

Cheever, A. 2021. Living Foundries. DARPA. https://www.darpa.mil/program/living-foundries.

Connolly, J. B., J. D. Mumford, D. C. M. Glandorf, S. Hartely, O. T. Lewis, S. W. Evans, G. Turner, C. Beech, N. Sykes, M. B. Coulibaly, J. Romels, J. Teem, W. Tonui, B. Lovett, A. Mankad, A. Mnzava, S. Fuchs, T. D. Hackett, W. G. Landis, J. M. Marshall, and F. A. Antwi. 2022.

Suggested Citation:"Appendix D: Biotechnology." National Academies of Sciences, Engineering, and Medicine. 2023. Transforming EPA Science to Meet Today's and Tomorrow's Challenges. Washington, DC: The National Academies Press. doi: 10.17226/26602.
×

Recommendations for environmental risk assessment of gene drive applications for malaria vector control. Malaria Journal 21:152. https://doi.org/10.1186/s12936-022-04183-w.

DARPA (Defense Advanced Research Projects Agency). 2017. Building the Safe Genes Toolkit. https://www.darpa.mil/news-events/2017-07-19.

Eid, J., A. Fehr, J. Gray, K. Luong, J. Lyle, G. Otto, P. Peluso, D. Rank, P. Baybayan, B. Bettman, A. Bibillo, K. Bjornson, B. Chaudhuri, F. Christians, R. Cicero, S. Clark, R. Dalal, A. Dewinter, J. Dixon, M. Foquet, A. Gaertner, P. Hardenbol, C. Heiner, K. Hester, D. Holden, G. Kearns, X. Kong, R. Kuse, Y. Lacroix, S. Lin, P. Lundquist, C. Ma, P. Marks, M. Maxham, D. Murphy, I. Park, T. Pham, M. Phillips, J. Roy, R. Sebra, G. Shen, J. Sorenson, A. Tomaney, K. Travers, M. Trulson, J. Vieceli, J. Wegener, D. Wu, A. Yang, D. Zaccarin, P. Zhao, F. Zhong, J. Korlach, and S. Turner. 2009. Real-time DNA sequencing from single polymerase molecules. Science 323(5910):133-138. https://doi.org/10.1126/science.1162986.

EPA (U.S. Environmental Protection Agency). 2020. Assessment Tools for Biotechnology Products. https://www.epa.gov/research-grants/assessment-tools-biotechnology-products.

Gallo, M. E., J. F. Sargent, Jr., A. K. Sarata, and T. Cowan. 2018. Advanced Gene Editing: CRISPR-Cas9. R44824. Congressional Research Service. https://crsreports.congress.gov/product/details?prodcode=R44824.

Harrill, J. A., L. J. Everett, D. E. Haggard, T. Sheffield, J. L. Bundy, C. M. Willis, R. S. Thomas, I. Shah, and R. S. Judson. 2018. High-throughput transcriptomics platform for screening environmental chemicals. Toxicological Sciences 181(1):68-89. https://doi.org/10.1093/toxsci/kfab009.

Kemp, L., L. Adam, C. R. Boehm, R. Breitling, R. Casagrande, M. Dando, A. Djikeng, N. G. Evans, R. Hammond, K. Hills, L. A. Holt, T. Kuiken, A. Markotić, P. Millett, J. A. Napier, C. Nelson, S. S. ÓhÉigeartaigh, A. Osbourn, M. J. Palmer, N. J. Patron, E. Perello, W. Piyawattanametha, V. Restrepo-Schild, C. Rios-Rojas, C. Rhodes, A. Roessing, D. Scott, P. Shapira, C. Simuntala, R. D. J. Smith, L. S. Sundaram, E. Takano, G. Uttmark, B. C. Wintle, N. B. Zahra, and W. J. Sutherland. 2020. Point of view: Bioengineering horizon scan 2020. eLife 9:e54489. https://doi.org/10.7554/eLife.54489.

NASEM (National Academies of Sciences, Engineering, and Medicine). 2016. Gene Drives on the Horizon: Advancing Science, Navigating Uncertainty, and Aligning Research with Public Values. Washington, DC: The National Academies Press. https://doi.org/10.17226/23405.

NASEM. 2017. Preparing for Future Products of Biotechnology. Washington, DC: The National Academies Press. https://doi.org/10.17226/24605.

Nawy, T. 2014. Single-cell sequencing. Nature Methods 11:18. https://doi.org/10.1038/nmeth.2771.

NIH (National Institutes of Health). 2021. Novel and Exceptional Technology and Research Advisory Committee: Gene Drives in Biomedical Research Report. https://osp.od.nih.gov/wp-content/uploads/NExTRAC-Gene-Drives-Final-Report.pdf.

Oye, K. A., K. Esvelt, E. Appleton, F. Catteruccia, G. Church, T. Kuiken, S. B. Y. Lightfoot, J. McNamara, A. Smidler, and J. P. Collins. 2014. Regulating gene drives. Science 345(6197):626-628. https://doi.org/10.1126/science.1254287.

Redford, K., T. Brooks, N. B. W. Macfarlane, J. S. Adams, L. Alphey, E. Bennet, J. Delborne, H. Eggermont, K. Esvelt, A. KinGirl, A. Kokotovich, B. Kolodziejczyk, T. Kuiken, N. B. W. Macfarlane, A. Mead, M. J. Olivia, E. Perello, L. Slobodian, D. Thizy, D. M. Tompkins, G. Winter, K. J. Campbell, J. E. Elsensohn, N. D. Holmes, C. Farmer, B. Keitt, P. Leftwich, T. Maloney, D. Masiga, A. E. Newhouse, B. Novak, R. Phelan, W. A. Powell, L. Rollins-Smith, and M. van Oppen. 2019. Genetic Frontiers for Conservation: An Assessment of Synthetic Biology and Biodiversity Conservation. Technical Report. https://doi.org/10.13140/RG.2.2.18929.12644.

Shapiro, E., T. Biezuner, and S. Linnarsson. 2013. Single-cell sequencing-based technologies will revolutionize whole-organism science. Nature Reviews Genetics 14(9):618-630. https://doi.org/10.1038/nrg3542.

Tang, X., Y. Huang, J. Lei, H. Luo, and X. Zhu. 2019.The single-cell sequencing: New developments and medical applications. Cell & Bioscience 9(1):1-9. https://doi.org/10.1186/s13578-019-0314-y.

Suggested Citation:"Appendix D: Biotechnology." National Academies of Sciences, Engineering, and Medicine. 2023. Transforming EPA Science to Meet Today's and Tomorrow's Challenges. Washington, DC: The National Academies Press. doi: 10.17226/26602.
×

USEOP (Executive Office of the President). 2017. Modernizing the Regulatory System for Biotechnology Products: Final Version of the 2017 Update to the Coordinated Framework for the Regulation of Biotechnology. https://www.epa.gov/regulation-biotechnology-under-tsca-and-fifra/update-coor-dinated-framework-regulation-biotechnology.

Wang, Y., and N. E. Navin. 2015. Advances and applications of single-cell sequencing technologies. Molecular Cell 58(4):598-609. https://doi.org/10.1016/j.molcel.2015.05.005.

White, T. 2021. First GMO mosquitoes to be released in the Florida Keys. Grist. https://grist.org/science/first-gmo-mosquitoes-to-be-released-in-the-florida-keys.

Zhang, Y. H. P., J. Sun, and Y. Ma. 2017. Biomanufacturing: History and perspective. Journal of Industrial Microbiology and Biotechnology 44(4-5):773-784. https://doi.org/10.1007/s10295-016-1863-2.

Suggested Citation:"Appendix D: Biotechnology." National Academies of Sciences, Engineering, and Medicine. 2023. Transforming EPA Science to Meet Today's and Tomorrow's Challenges. Washington, DC: The National Academies Press. doi: 10.17226/26602.
×
Page 130
Suggested Citation:"Appendix D: Biotechnology." National Academies of Sciences, Engineering, and Medicine. 2023. Transforming EPA Science to Meet Today's and Tomorrow's Challenges. Washington, DC: The National Academies Press. doi: 10.17226/26602.
×
Page 131
Suggested Citation:"Appendix D: Biotechnology." National Academies of Sciences, Engineering, and Medicine. 2023. Transforming EPA Science to Meet Today's and Tomorrow's Challenges. Washington, DC: The National Academies Press. doi: 10.17226/26602.
×
Page 132
Suggested Citation:"Appendix D: Biotechnology." National Academies of Sciences, Engineering, and Medicine. 2023. Transforming EPA Science to Meet Today's and Tomorrow's Challenges. Washington, DC: The National Academies Press. doi: 10.17226/26602.
×
Page 133
Suggested Citation:"Appendix D: Biotechnology." National Academies of Sciences, Engineering, and Medicine. 2023. Transforming EPA Science to Meet Today's and Tomorrow's Challenges. Washington, DC: The National Academies Press. doi: 10.17226/26602.
×
Page 134
Suggested Citation:"Appendix D: Biotechnology." National Academies of Sciences, Engineering, and Medicine. 2023. Transforming EPA Science to Meet Today's and Tomorrow's Challenges. Washington, DC: The National Academies Press. doi: 10.17226/26602.
×
Page 135
Next: Appendix E: Participatory Research Approaches »
Transforming EPA Science to Meet Today's and Tomorrow's Challenges Get This Book
×
 Transforming EPA Science to Meet Today's and Tomorrow's Challenges
Buy Paperback | $36.00 Buy Ebook | $28.99
MyNAP members save 10% online.
Login or Register to save!
Download Free PDF

Since its establishment in 1970, the mission of the Environmental Protection Agency is to protect human health and the environment. EPA develops regulations, ensures compliance, and issues policies, in coordination with state, tribal, and local governments. To accomplish its mission, EPA should be equipped to produce and access the highest quality and most advanced science. The Office of Research and Development (ORD) provides the scientific bases for regulatory and public health policies that have broad impacts on the nation’s natural resources and quality of human life, and that yield economic benefits and incur compliance costs for the regulated community. In addition, ORD develops the agency core research capabilities, providing tools and methods for meeting current and anticipating future environmental challenges, such as the risks to health and the environment posed by climate change. Because challenges associated with environmental protection today are complex and affected by many interacting factors, the report points to the need for a substantially broader and better integrated approach to environmental protection.

This report calls for EPA ORD to pursue all of its scientific aims in a new framework—to apply systems thinking to a One Environment − One Health approach in all aspects of ORD work. To accomplish this, the report provides actionable recommendations on how ORD might consider incorporating emerging science and systems thinking into the agency research planning, so that ORD can become an increasingly impactful organization. The report identifies a number of high-priority recommendations for ORD to pursue in taking advantage of a broad range of advanced tools, in concert with collaborators in other federal agencies and the broader scientific community. Given the resource constraints, the report recognizes that ORD will have to make decisions about priorities for implementing its recommendations, and that ORD leadership is in the best position to set those priorities as implementation begins. The report concluded by stating that shifting to a systems-thinking approach will require renewed support from science leadership, enhanced strategic planning, investment in new and broader expertise and tools, and a reimagined and inclusive commitment to communication and collaboration.

READ FREE ONLINE

  1. ×

    Welcome to OpenBook!

    You're looking at OpenBook, NAP.edu's online reading room since 1999. Based on feedback from you, our users, we've made some improvements that make it easier than ever to read thousands of publications on our website.

    Do you want to take a quick tour of the OpenBook's features?

    No Thanks Take a Tour »
  2. ×

    Show this book's table of contents, where you can jump to any chapter by name.

    « Back Next »
  3. ×

    ...or use these buttons to go back to the previous chapter or skip to the next one.

    « Back Next »
  4. ×

    Jump up to the previous page or down to the next one. Also, you can type in a page number and press Enter to go directly to that page in the book.

    « Back Next »
  5. ×

    Switch between the Original Pages, where you can read the report as it appeared in print, and Text Pages for the web version, where you can highlight and search the text.

    « Back Next »
  6. ×

    To search the entire text of this book, type in your search term here and press Enter.

    « Back Next »
  7. ×

    Share a link to this book page on your preferred social network or via email.

    « Back Next »
  8. ×

    View our suggested citation for this chapter.

    « Back Next »
  9. ×

    Ready to take your reading offline? Click here to buy this book in print or download it as a free PDF, if available.

    « Back Next »
Stay Connected!