National Academies Press: OpenBook

Assessing and Responding to the Growth of Computer Science Undergraduate Enrollments (2018)

Chapter: 2 Historical Degree Production in Computing

« Previous: 1 Introduction
Suggested Citation:"2 Historical Degree Production in Computing." National Academies of Sciences, Engineering, and Medicine. 2018. Assessing and Responding to the Growth of Computer Science Undergraduate Enrollments. Washington, DC: The National Academies Press. doi: 10.17226/24926.
×

2

Historical Degree Production in Computing

Before assessing current undergraduate computing enrollment trends at U.S. institutions, it is imperative to consider the historical context. The most authoritative data on the historical production of computer science (CS) bachelor’s degrees lie in the national statistics on degree completions tracked by the Department of Education’s Integrated Postsecondary Education Data System (IPEDS).

This chapter presents and discusses time series trends in degree production to provide context for discussion of current enrollment trends. Specifically, it examines degree production trends in CS and related fields relative to net production of bachelor’s degrees over time, distribution of postsecondary degrees produced in these fields, past economic and institutional factors that likely contributed to past CS bachelor’s degree production trends, and variations by institution type from 2009 to 2015 to highlight the range of experiences at different institutions.

The IPEDS data discussed in this chapter come from three different cross sections of CS and related fields, labeled and defined as follows:1

  1. CISIncludes the entire 11.x series of IPEDS Classification of Instructional Programs (CIPs), referred to within IPEDS alternately as “computer science” and “computer and information science and support services.” This broad category includes core computer science, information science/studies, information technology, and related fields, some of which are more vocational than traditional computer science programs.

___________________

1 See the section “Data Used in the Development of This Report” in Chapter 1 for additional discussion of the IPEDS classification system for CS and related fields.

Suggested Citation:"2 Historical Degree Production in Computing." National Academies of Sciences, Engineering, and Medicine. 2018. Assessing and Responding to the Growth of Computer Science Undergraduate Enrollments. Washington, DC: The National Academies Press. doi: 10.17226/24926.
×
  1. Core CS—Includes only “Computer and Information Sciences, General” (11.0101) and “Computer Science” (11.0701). These two CIPs have been considered to be closest to the core computer science degree programs currently offered at institutions of higher education offering bachelor’s and higher-level degrees. However, this set of classifiers may not necessarily reflect temporal trends in degree production accurately, due to the changes in IPEDS CIP codes in 2000 and 2010.
  2. Computer engineering (CE)—Includes degrees from the 14.09xx series, identified as “Computer Engineering, General” (14.0901), “Computer Hardware Engineering” (14.0902), “Computer Software Engineering” (14.0903), and “Computer Engineering, Other” (14.0999).

Details about the full set of classifiers of all plotted data from IPEDS are described in Appendix F.

HISTORICAL PRODUCTION OF CIS AND CE BACHELOR’S DEGREES

Since the emergence of CS programs in the 1960s, overall production of CS and related bachelor’s degrees at U.S. institutions of higher education has grown significantly. CE was first uniquely identified as a subfield of engineering in federal education statistics in 1987, and generates about 10 percent of the number of graduates produced in CIS. The number and share of CIS and CE degrees produced over time are illustrated in Figure 2.1, with total bachelor’s degree production in all fields indicated as a dashed line for context (vertical scale read from the right axis).2 The plots for “All Institutions” include bachelor’s degrees at all public, private not-for-profit, and private for-profit institutions; plots for “Not-for-Profits” exclude the bachelor’s degrees conferred by for-profit institutions.

The significant growth in the 50 years since the emergence of computer science as a unique academic discipline is marked by two striking peaks, with subsequent valleys resetting at a higher absolute level than the presurge level. Specifically, the absolute number of CIS bachelor’s degrees reported annually rose from 89 in 1966 to 60,309 in 2015, with peaks in 1986 (42,195 bachelor’s degrees) and 2003 (57,926 bachelor’s degrees) and valleys in between (24,553 in 1994 and 38,496 in 2009). CE also exhibits historical fluctuations.

CIS BACHELOR’S DEGREES GOING TO FOREIGN STUDENTS

The total number and fraction of all U.S. postsecondary degrees awarded in CIS to temporary residents (international students) are illustrated in Figure 2.2.

___________________

2 See Chapter 1 for a more detailed description of the associated data source (IPEDS degree completions data) and associated limitations.

Suggested Citation:"2 Historical Degree Production in Computing." National Academies of Sciences, Engineering, and Medicine. 2018. Assessing and Responding to the Growth of Computer Science Undergraduate Enrollments. Washington, DC: The National Academies Press. doi: 10.17226/24926.
×
images
FIGURE 2.1 Historical year-to-year U.S. production of bachelor’s degrees in computer and information science and support services (CIS, black line), core CS (dark gray line), and computer engineering (CE, light gray line), in absolute number (top row) and as a percentage (bottom row) of all bachelor’s degrees at all institutions (left column) and at not-for-profit institutions (right column). The total number of bachelor’s degrees produced in the United States each year in all fields is included in the top row for all institutions (left panel) and for not-for-profit institutions (right panel) as a dashed line for reference, with the vertical scale indicated on the right-hand axis. SOURCE: Data from IPEDS completions survey accessed via the WebCASPAR online database. See Appendix F for details.

Although a moderate increase in the share of CIS bachelor’s degrees earned by international students occurred between 2008 and 2015 (from 4.6 to 5.6 percent overall), this constitutes only a small portion of U.S. bachelor’s degree production, and suggests that little of the recent surge is due to increased participation among foreign students.3 The fraction of CIS bachelor’s degrees awarded to temporary residents in 2015 remained below past peak levels.

___________________

3 Note that there is some uncertainty in these data given that a nontrivial fraction (around 10 percent in recent years) of these students declared neither a specific race/ethnicity nor status as a temporary resident (which are treated as mutually exclusive categories within the IPEDS classification system).

Suggested Citation:"2 Historical Degree Production in Computing." National Academies of Sciences, Engineering, and Medicine. 2018. Assessing and Responding to the Growth of Computer Science Undergraduate Enrollments. Washington, DC: The National Academies Press. doi: 10.17226/24926.
×
images
FIGURE 2.2 Number and share of U.S. degrees in CIS awarded to students designated as temporary residents of the United States (foreign students). SOURCE: Data from IPEDS completions survey accessed via the WebCASPAR online database. See Appendix F for details.

VARIATION IN CIS BACHELOR’S DEGREE PRODUCTION BY INSTITUTION TYPE

While the overall picture of computing degree production is helpful, it represents only aggregate trends and not the variation of experiences at different institutions. In the following these data are broken out in more detail using the IPEDS classifiers of “Institutional Control” (to identify trends at public, private,

Suggested Citation:"2 Historical Degree Production in Computing." National Academies of Sciences, Engineering, and Medicine. 2018. Assessing and Responding to the Growth of Computer Science Undergraduate Enrollments. Washington, DC: The National Academies Press. doi: 10.17226/24926.
×

and for-profit institutions) and “Carnegie Classification” (to identify trends by institution type).

Public, Private, and For-Profit Institutions

The historical production of degrees (at all levels) in CIS and CE is broken out for the categories of public, private, and for-profit institutions in Figure 2.3, beginning with the earliest dates for which data with the corresponding classifiers are available.

Between 2000 and 2005, for-profit institutions emerged as a significant source of CIS degrees, roughly matching the number awarded at not-for-profit private institutions. It is noteworthy that CIS accounted for between 8 and 28 percent of bachelor’s degrees awarded at for-profit institutions since 1987, but accounted for only between 2 and 4 percent of bachelor’s degrees at public and private institutions. Again, this likely reflects both the breadth of the CIS classifier in IPEDS and the nature of the computing labor market. Since 2013 the number of CIS bachelor’s degrees awarded at for-profit institutions has been falling, as has the relative fraction of bachelor’s degrees conferred in CIS (compared to the number conferred in all disciplines) at for-profit institutions.

CIS degree production at public and private not-for-profit institutions has surged since 2009. The increases have been most pronounced at public institutions, which produced more degrees in 2015 (33,930) than during the dot-com era peak in 2003, representing an increase of 87 percent since the post-dot-com

images
FIGURE 2.3 Bachelor’s degree production from 1987 to 2015 in CIS and CE at public, private, and for-profit institutions reporting to IPEDS. SOURCE: Data from IPEDS completions survey accessed online via the WebCASPAR online database. See Appendix F for details.
Suggested Citation:"2 Historical Degree Production in Computing." National Academies of Sciences, Engineering, and Medicine. 2018. Assessing and Responding to the Growth of Computer Science Undergraduate Enrollments. Washington, DC: The National Academies Press. doi: 10.17226/24926.
×

low of 18,189 in 2009. At private institutions 15,361 degrees were produced in 2015 (compared to a peak of 17,846 in 2003), a 52 percent increase since 2009.

As previously noted overall bachelor’s degree production has also been increasing, as illustrated in Figure 2.4. Nonetheless, CIS bachelor’s degree production has been increasing at an even higher rate, as illustrated in Figure 2.1. The number of CIS bachelor’s degrees produced annually at all not-for-profit institutions increased by 74 percent between 2009 and 2015, compared to an overall increase in bachelor’s degree production of only 16 percent at not-for-profits during the same period.

Carnegie Classification

American institutions of higher education are very diverse, and it is important to consider how CS production has varied at the different institution types to get an accurate picture. To illustrate which institutions have experienced the most growth in recent years, these data are broken down further by survey-specific (2010) Carnegie Classification4 and by for-profit status.5 Degree production trends by institution type are illustrated in Figure 2.5 for the following categories of institution:

  • Research includes institutions classified as not-for-profit doctoral-degree-granting institutions with “very high” or “high” research activity, both public and private.
  • Doctoral includes all other not-for-profit doctoral degree granting institutions, both public and private.
  • For-profit doctoral includes all for-profit doctoral institutions.
  • For-profit, other includes all other for-profit institutions.
  • Master’s includes not-for-profit institutions whose highest degree offered (in any field) is at the master’s level (many of these have a professional character).
  • Bachelor’s includes not-for-profit institutions at which a bachelor’s is the terminal degree, including many liberal arts colleges.
  • Associate’s includes institutions that primarily offer associate’s degrees, but also have some bachelor’s degree programs.
  • Other/unknown includes not-for-profit tribal colleges, special-focus institutions, and institutions that did not report a Carnegie Classification.

Combined, research and master’s institutions have long produced the majority (67 percent in 2015) of all CIS bachelor’s degrees. Research institutions reached a peak in CIS bachelor’s production in 2003, then fell until 2008, after which the number climbed again, surpassing the 2003 peak in 2015. Doctoral, master’s, and

___________________

4 For the Carnegie Classification definitions and methodology, please see The Carnegie Classifications of Institutions of Higher Education (2017).

5 Via the IPEDS “Institutional Control” classifier.

Suggested Citation:"2 Historical Degree Production in Computing." National Academies of Sciences, Engineering, and Medicine. 2018. Assessing and Responding to the Growth of Computer Science Undergraduate Enrollments. Washington, DC: The National Academies Press. doi: 10.17226/24926.
×
images
FIGURE 2.4 Total annual bachelor’s degree production over time for public, private, and for-profit institutions (all academic fields). Private not-for-profit and private for-profit institutions were not distinguished prior to 1987. SOURCE: Data from IPEDS completions survey accessed via the WebCASPAR online database. See Appendix F for details.
images
FIGURE 2.5 CIS bachelor’s degree production by category of institution. Categories include only not-for-profit institutions, unless otherwise indicated. SOURCE: Data from IPEDS completions survey accessed via the WebCASPAR online database. See Appendix F for details.
Suggested Citation:"2 Historical Degree Production in Computing." National Academies of Sciences, Engineering, and Medicine. 2018. Assessing and Responding to the Growth of Computer Science Undergraduate Enrollments. Washington, DC: The National Academies Press. doi: 10.17226/24926.
×

bachelor’s institutions follow a similar trend, but only nearly reaching their 2003 peaks in 2015. Production at for-profit institutions has exhibited a significant falloff beginning in 2013 (for-profit doctoral institutions) and 2014 (other for-profits).

Since 2009, growth in CIS bachelor’s degree production has occurred at research, master’s, doctoral, and bachelor’s institutions, though at different average rates. For-profit institutions experienced some growth, and then dropped precipitously. The recent (between 2009 and 2015) growth is having the largest impact on research institutions (97 percent increase), followed by master’s institutions (69 percent increase), other doctoral institutions (50 percent increase), and bachelor’s institutions (33 percent increase), on average.

For a closer look at relative trends in research institutions, this category was further separated by level of research activity. Figure 2.6 illustrates the total number of CIS degrees produced over time for those institutions with very high research activity (The Carnegie Classifications of Institutions of Higher Education, 2017). Active research institutions display much more pronounced growth than nonresearch doctoral institutions. Thus, production has shifted toward leading research institutions. As with the other categories, time will determine whether this reflects concentration at the top or a lag in growth.

To provide a sense of the nature of the recent onset of growth at not-for-profit institutions, the average number of degrees per institution in 2009 and 2015 is listed in Table 2.1 for all institution categories that have displayed increased

images
FIGURE 2.6 Historical CIS bachelor’s degree production at not-for-profit doctoral (Ph.D.granting) institutions, including very-high-research-activity institutions, high-research-activity institutions, and other doctoral institutions, 1987-2017. SOURCE: Data from IPEDS completions survey accessed via the WebCASPAR online database. See Appendix F for details.
Suggested Citation:"2 Historical Degree Production in Computing." National Academies of Sciences, Engineering, and Medicine. 2018. Assessing and Responding to the Growth of Computer Science Undergraduate Enrollments. Washington, DC: The National Academies Press. doi: 10.17226/24926.
×

TABLE 2.1 Change in Average Number and Institutional Share of CIS Bachelor’s Degrees Produced per Institution by Not-for-Profit Institution Type, 2009-2015

Survey-Specific Carnegie Classification of Institution CIS Average Number (and Share) of Bachelor’s Degrees per Institution Percent Increase in Average Number of Degrees per Institution
2009 2015
Very high research 65 (1.6%) 138 (3.0%) 113%
High research 44 (1.8%) 76 (2.6%) 74%
Doctoral 29 (1.9%) 42 (2.5%) 45%
Master’s 21 (1.9%) 35 (2.7%) 69%
Bachelor’s 10 (2.3%) 15 (2.8%) 42%
Associate’s 15 (4.9%) 26 (5.0%) 72%

NOTE: Average number of degrees per institution rounded to nearest integer. Only institutions reporting CIS bachelor’s degrees are included in each category. SOURCE: Data from IPEDS completions survey.

degree production since 2009. Average relative increases in program size are clearly higher for the more research-intensive institutions and for master’s institutions as compared to bachelor’s.

Some caution should be exercised when using these data to make assumptions about the nature of any particular CIS program, as program size does not follow a normal distribution. Overall, the top 10 percent of CIS degree producers are responsible for more than 50 percent of the degrees, and the smallest 50 percent of the institutions produce less than 10 percent. Less than 10 percent of the institutions experiencing growth are responsible for more than 50 percent of the growth. Furthermore, degree production is but one aspect of the experience in computing programs.

FINDING 1: National bachelor’s degree production in computer and information science and support services at not-for-profit institutions increased significantly between 2009 and 2015 (by 74 percent), above and beyond the general rate of increase of bachelor’s degree production (16 percent) overall during this period. Over the longer term, the rate of growth has varied, with two notable large declines but with a positive long-term trend, and it has differed by institution type and among individual institutions.

National degree production data do not provide any indication that the growth will soon abate. Given a finite population, it must level off eventually, or even peak, but there is no strong basis for predicting when that will occur.

Comprehensive national data are not available on growth of course enrollments, which reflect the increase in demand for courses both by majors and by the general student population, as well as the emergence of various blended majors.

Suggested Citation:"2 Historical Degree Production in Computing." National Academies of Sciences, Engineering, and Medicine. 2018. Assessing and Responding to the Growth of Computer Science Undergraduate Enrollments. Washington, DC: The National Academies Press. doi: 10.17226/24926.
×

This topic is explored further in Chapter 3. Nonetheless, these data provide illustrative analyses of historical CIS degree production trends—in particular, in the context of the recent boom.

OTHER LEVELS OF DEGREE

Surges also occurred in the number of CIS associate’s degrees (peaking in 1984 with 12,913 degrees and in 2003 with 46,400 degrees). CIS certificates also exhibited a peak in 2003 (25,646 certificates), as did CE bachelor’s and associate’s and CIS master’s. In this recent growth wave, associate’s degrees in CIS from for-profit institutions have fallen substantially.

From Figure 2.7 it is apparent that a large number of CIS associate’s degrees and CIS certificates have been awarded, similar in magnitude to the number of CIS bachelor’s and master’s degrees, respectively, since the mid-1990s. It is notable that CIS, as classified in IPEDS, produces relatively more associate’s degrees and certificates than other science, technology, engineering, and mathematics fields.6 Several factors may contribute to this pattern. First, the large number of CIS certificates may reflect interest among non-majors in obtaining computing skills. The types of degrees that are categorized as CIS in IPEDS may also be at play—the corresponding CIP is inclusive of disciplines such as “Information Technology,” “Word Processing,” and “Computer Support Specialist,” which may be more vocational and thus more likely to offer these degrees. Finally, the nature of the market for computing skills may stimulate interest in these degrees.7

RESPONDING TO ENROLLMENT SURGES

In general, several categories of responses are available to institutions in the face of booming enrollments: (1) limit participation, (2) grow programs and the resources that feed them, (3) leverage resources in new ways, (4) restructure the nature of computing education within the institution, and (5) make no active changes, allowing higher burdens to be placed on existing resources. The categories range from maintaining current practices, to relatively inexpensive and nondisruptive actions, to significant changes in organization or resource commitments. They are not exclusive and typically are deployed in combination. A range of influences, including specific institutional actions and other influences, may apply over the course of a student’s academic career, and may affect the character and culture of the program and institution.

In the rest of this report dimensions of the current CS enrollment surge are explored, including potential impacts of related institutional actions, which are discussed in more depth in Chapter 6. A discussion of anecdotes from past CS enrollments surge is provided in Box 2.1.

___________________

6 This is discussed further in Chapter 4.

7 See Chapter 4 for further discussion of the labor market.

Suggested Citation:"2 Historical Degree Production in Computing." National Academies of Sciences, Engineering, and Medicine. 2018. Assessing and Responding to the Growth of Computer Science Undergraduate Enrollments. Washington, DC: The National Academies Press. doi: 10.17226/24926.
×
images
FIGURE 2.7 Historical annual degree production in CIS by level of degree. All institutions are illustrated in the left-hand panel, and not-for-profits only in the right-hand panel. Data are for all institutions that reported to IPEDS. SOURCE: Data from IPEDS completions survey accessed via the WebCASPAR online database. See Appendix F for details.
Suggested Citation:"2 Historical Degree Production in Computing." National Academies of Sciences, Engineering, and Medicine. 2018. Assessing and Responding to the Growth of Computer Science Undergraduate Enrollments. Washington, DC: The National Academies Press. doi: 10.17226/24926.
×
Suggested Citation:"2 Historical Degree Production in Computing." National Academies of Sciences, Engineering, and Medicine. 2018. Assessing and Responding to the Growth of Computer Science Undergraduate Enrollments. Washington, DC: The National Academies Press. doi: 10.17226/24926.
×
Suggested Citation:"2 Historical Degree Production in Computing." National Academies of Sciences, Engineering, and Medicine. 2018. Assessing and Responding to the Growth of Computer Science Undergraduate Enrollments. Washington, DC: The National Academies Press. doi: 10.17226/24926.
×
Suggested Citation:"2 Historical Degree Production in Computing." National Academies of Sciences, Engineering, and Medicine. 2018. Assessing and Responding to the Growth of Computer Science Undergraduate Enrollments. Washington, DC: The National Academies Press. doi: 10.17226/24926.
×
Page 25
Suggested Citation:"2 Historical Degree Production in Computing." National Academies of Sciences, Engineering, and Medicine. 2018. Assessing and Responding to the Growth of Computer Science Undergraduate Enrollments. Washington, DC: The National Academies Press. doi: 10.17226/24926.
×
Page 26
Suggested Citation:"2 Historical Degree Production in Computing." National Academies of Sciences, Engineering, and Medicine. 2018. Assessing and Responding to the Growth of Computer Science Undergraduate Enrollments. Washington, DC: The National Academies Press. doi: 10.17226/24926.
×
Page 27
Suggested Citation:"2 Historical Degree Production in Computing." National Academies of Sciences, Engineering, and Medicine. 2018. Assessing and Responding to the Growth of Computer Science Undergraduate Enrollments. Washington, DC: The National Academies Press. doi: 10.17226/24926.
×
Page 28
Suggested Citation:"2 Historical Degree Production in Computing." National Academies of Sciences, Engineering, and Medicine. 2018. Assessing and Responding to the Growth of Computer Science Undergraduate Enrollments. Washington, DC: The National Academies Press. doi: 10.17226/24926.
×
Page 29
Suggested Citation:"2 Historical Degree Production in Computing." National Academies of Sciences, Engineering, and Medicine. 2018. Assessing and Responding to the Growth of Computer Science Undergraduate Enrollments. Washington, DC: The National Academies Press. doi: 10.17226/24926.
×
Page 30
Suggested Citation:"2 Historical Degree Production in Computing." National Academies of Sciences, Engineering, and Medicine. 2018. Assessing and Responding to the Growth of Computer Science Undergraduate Enrollments. Washington, DC: The National Academies Press. doi: 10.17226/24926.
×
Page 31
Suggested Citation:"2 Historical Degree Production in Computing." National Academies of Sciences, Engineering, and Medicine. 2018. Assessing and Responding to the Growth of Computer Science Undergraduate Enrollments. Washington, DC: The National Academies Press. doi: 10.17226/24926.
×
Page 32
Suggested Citation:"2 Historical Degree Production in Computing." National Academies of Sciences, Engineering, and Medicine. 2018. Assessing and Responding to the Growth of Computer Science Undergraduate Enrollments. Washington, DC: The National Academies Press. doi: 10.17226/24926.
×
Page 33
Suggested Citation:"2 Historical Degree Production in Computing." National Academies of Sciences, Engineering, and Medicine. 2018. Assessing and Responding to the Growth of Computer Science Undergraduate Enrollments. Washington, DC: The National Academies Press. doi: 10.17226/24926.
×
Page 34
Suggested Citation:"2 Historical Degree Production in Computing." National Academies of Sciences, Engineering, and Medicine. 2018. Assessing and Responding to the Growth of Computer Science Undergraduate Enrollments. Washington, DC: The National Academies Press. doi: 10.17226/24926.
×
Page 35
Suggested Citation:"2 Historical Degree Production in Computing." National Academies of Sciences, Engineering, and Medicine. 2018. Assessing and Responding to the Growth of Computer Science Undergraduate Enrollments. Washington, DC: The National Academies Press. doi: 10.17226/24926.
×
Page 36
Suggested Citation:"2 Historical Degree Production in Computing." National Academies of Sciences, Engineering, and Medicine. 2018. Assessing and Responding to the Growth of Computer Science Undergraduate Enrollments. Washington, DC: The National Academies Press. doi: 10.17226/24926.
×
Page 37
Suggested Citation:"2 Historical Degree Production in Computing." National Academies of Sciences, Engineering, and Medicine. 2018. Assessing and Responding to the Growth of Computer Science Undergraduate Enrollments. Washington, DC: The National Academies Press. doi: 10.17226/24926.
×
Page 38
Next: 3 The Current Landscape of Computer Science Enrollments »
Assessing and Responding to the Growth of Computer Science Undergraduate Enrollments Get This Book
×
Buy Paperback | $70.00 Buy Ebook | $54.99
MyNAP members save 10% online.
Login or Register to save!
Download Free PDF

The field of computer science (CS) is currently experiencing a surge in undergraduate degree production and course enrollments, which is straining program resources at many institutions and causing concern among faculty and administrators about how best to respond to the rapidly growing demand. There is also significant interest about what this growth will mean for the future of CS programs, the role of computer science in academic institutions, the field as a whole, and U.S. society more broadly.

Assessing and Responding to the Growth of Computer Science Undergraduate Enrollments seeks to provide a better understanding of the current trends in computing enrollments in the context of past trends. It examines drivers of the current enrollment surge, relationships between the surge and current and potential gains in diversity in the field, and the potential impacts of responses to the increased demand for computing in higher education, and it considers the likely effects of those responses on students, faculty, and institutions. This report provides recommendations for what institutions of higher education, government agencies, and the private sector can do to respond to the surge and plan for a strong and sustainable future for the field of CS in general, the health of the institutions of higher education, and the prosperity of the nation.

  1. ×

    Welcome to OpenBook!

    You're looking at OpenBook, NAP.edu's online reading room since 1999. Based on feedback from you, our users, we've made some improvements that make it easier than ever to read thousands of publications on our website.

    Do you want to take a quick tour of the OpenBook's features?

    No Thanks Take a Tour »
  2. ×

    Show this book's table of contents, where you can jump to any chapter by name.

    « Back Next »
  3. ×

    ...or use these buttons to go back to the previous chapter or skip to the next one.

    « Back Next »
  4. ×

    Jump up to the previous page or down to the next one. Also, you can type in a page number and press Enter to go directly to that page in the book.

    « Back Next »
  5. ×

    Switch between the Original Pages, where you can read the report as it appeared in print, and Text Pages for the web version, where you can highlight and search the text.

    « Back Next »
  6. ×

    To search the entire text of this book, type in your search term here and press Enter.

    « Back Next »
  7. ×

    Share a link to this book page on your preferred social network or via email.

    « Back Next »
  8. ×

    View our suggested citation for this chapter.

    « Back Next »
  9. ×

    Ready to take your reading offline? Click here to buy this book in print or download it as a free PDF, if available.

    « Back Next »
Stay Connected!