National Academies Press: OpenBook
« Previous: 4 ELEMENTS AND GROWTH OF THE PROGRAM
Suggested Citation:"5 DATA MANAGEMENT." National Research Council. 1994. GOALS (Global Ocean-Atmosphere-Land System) for Predicting Seasonal-to-Interannual Climate: A Program of Observation, Modeling, and Analysis. Washington, DC: The National Academies Press. doi: 10.17226/4811.
×

5
Data Management

The GOALS program would require a robust data management system. The data management plan would likely develop from current TOGA and post-TOGA data management plans. Being a broader study, however, GOALS would encompass new data sets from field experiments, specialized data sets, and data sets derived from new observational networks designed to complement existing global measurements. The amount of data used and produced by GOALS is expected to be significantly greater than that used and produced by TOGA. Moreover, unique requirements for GOALS would probably arise with the introduction of new operational observation platforms or techniques, portable self-describing data formats, novel data transmission technologies, and the development of technology such as larger mass storage systems. The benefits of cross-program science transfer and the likelihood of tight budgets in the future make paramount the need to share resources with other programs. Using facilities and expertise that are already developed and proven ensures both economy of effort and continuity. Also, the transition from a research to an operational mode that is proposed for GOALS has impacts on the budget process, funding sources, and data management responsibilities.

PRINCIPLES AND OBJECTIVES

Data management requirements should be driven by the science and operational requirements for data streams for both near-real-time and

Suggested Citation:"5 DATA MANAGEMENT." National Research Council. 1994. GOALS (Global Ocean-Atmosphere-Land System) for Predicting Seasonal-to-Interannual Climate: A Program of Observation, Modeling, and Analysis. Washington, DC: The National Academies Press. doi: 10.17226/4811.
×

retrospective use. Data streams and data sets would be variable, with the type and format of the data differing, depending on their origin (such as new and existing observing systems, field research programs, and experimental programs). Attention to data quality and continuity would be imperative.

During the 15-year time frame of the program, hundreds of gigabytes of data would be collected and analyzed—and then used well beyond the lifetime of the program. (Data sets from the GARP Atlantic Tropical Experiment, for example, are still being used many years after the termination of the experiment.) Clearly, it would be essential that data sets and data streams from GOALS be safely archived and remain easily accessible to the research community.

As the number of users of data sets evolved—including modeling and satellite data sets, and in situ measurements such as those from TOGA-COARE and the Global Climate Observing System—the GOALS data management system would need to be able to handle new data streams. A data management plan to accommodate near-term efforts and to provide a framework for long-term goals would then be required. This would be particularly important with the emergence of the synergy between GOALS and other international programs that address global dynamics (for example, GEWEX, GCOS, GOOS, ACCP, WOCE, JGOFS).

The following list of principles and objectives should guide the development of a detailed GOALS data management plan:

  1. Data are distributed as soon as possible, and there is full and open exchange of data and derived products.

  2. Reanalysis is an integral part of the program; this necessitates assessable retention of observations in original form.

  3. Sufficient metadata (quality control flags, instrument history, processing attributes, and so on), are provided so that researchers can evaluate the usefulness of the data.

  4. An ongoing, collaborative effort is maintained between data managers and researchers to assess standards for the production of data sets.

  5. Some data and data display tools are available on-line and in near real-time.

  6. Backup data sets are archived to accommodate any change in parameters or algorithms that would affect derived quantities.

  7. Other data management activities, such as the EOS Data and Information System (EOSDIS) are monitored and evaluated for their relevance and applicability to GOALS.

Suggested Citation:"5 DATA MANAGEMENT." National Research Council. 1994. GOALS (Global Ocean-Atmosphere-Land System) for Predicting Seasonal-to-Interannual Climate: A Program of Observation, Modeling, and Analysis. Washington, DC: The National Academies Press. doi: 10.17226/4811.
×
  1. Real-time and delayed-mode four-dimensional data-assimilation systems provide fields to complement observations.

  2. There is a distributed data archive and access system involving the full range of regional, national, and world data centers.

  3. An on-line service is created with high-level project information (for example, the progress of an experiment, program information, availability of data), perhaps similar to other information systems currently in use, such as those for WOCE, TOGA-COARE, and Storm-scale Operational and Research Meteorology (STORM).

DATA CENTERS

Considerable infrastructure already exists to process, archive, and distribute Level I (radiance and similar unprocessed measurements), Level II (geophysical quantities), and Level III (assimilated or blended analyses) data sets. However, that infrastructure must be maintained and, in many instances, expanded. Similar to TOGA's data centers, existing institutions would be relied upon to a large extent to manage specialized data streams and data sets. Examples already exist in the TOGA program, where existing institutions have taken on the task of quality control and general support, such as:

  • The Tropical Sea Level Data Center (Hawaii) produces Level II-B sea level data,

  • The Tropical Ocean Subsurface Data Center (IFREMER, Brest, France) generates Level II-B subsurface temperature and salinity data,

  • The European Centre for Medium-Range Weather Forecasts (ECMWF) processes atmospheric Level III-A global meteorological fields,

  • The TOGA Marine Climatology Data Center (U.K. Meteorological Office) produces Level II-B marine surface meteorological data,

  • The Global Sea-Surface Temperature Data Center (NMC) performs Level II-A, III-A, and III-B processing of SST observations, and

  • The TOGA Upper-Air Data Center (New Delhi) has responsibility for upper-air observations.

Complementing these data centers are several TOGA-related institutes, universities, and national services that hold or produce data

Suggested Citation:"5 DATA MANAGEMENT." National Research Council. 1994. GOALS (Global Ocean-Atmosphere-Land System) for Predicting Seasonal-to-Interannual Climate: A Program of Observation, Modeling, and Analysis. Washington, DC: The National Academies Press. doi: 10.17226/4811.
×

sets of interest to TOGA researchers. Examples are NOAA's Atlantic Oceanographic and Meteorology Laboratory (AOML) for surface current drifter data; NOAA's Pacific Marine Environmental Laboratory (PMEL) for near-real-time data from the TOGA-TAO array; Florida State University for pseudo-wind stress fields; and WOCE Data Assembly Centers for various types of mooring, float, and drifter data, and sea-level and upper-ocean thermal data. In most cases, World Data Centers A and B for meteorology and oceanography are the final (delayed-mode) repository for all TOGA data sets.

To investigate the feasibility of predicting short-term climate variations, quality-controlled meteorological and oceanographic data from established data centers would be required to initialize forecast models. This would include the analysis of multivariate fields and considerable data processing and production activities, that is, data assimilation and modeling. Model initialization would require the merging and gridding of various fields through multivariate optimal interpolation or other techniques. This operation would entail an evolving set of quality-control procedures. Model runs would create large quantities of output that would have to be documented, archived, and distributed on various media. To achieve these goals, advanced data archiving, retrieval, and visualization capabilities would be required for both assimilation and forecast products. The dissemination of these data and information throughout the research community, and to other pertinent interests, would be of paramount importance to the program. This dissemination capability would require investments for leveraging existing and planned interoperable data systems that could provide GOALS scientists with access to data sets via common interfaces. The communication backbone for such a system must be capable of transmitting millions of bits per second.

To achieve its objectives, GOALS is very dependent on ongoing efforts within NASA, NOAA, National Science Foundation, U.S. Department of Defense, and U.S. Department of Energy data centers for the necessary infrastructure to support such a data management system. It is hoped that this in place network of data processing centers and data repositories would be able to provide expeditiously the GOALS program with some important state-of-the-art data management capabilities.

A major commitment of the GOALS program would be the assembly and analysis of a 30-year (1971-2000) climatic data set to examine seasonal-to-interannual variability. This effort would involve developing ways to incorporate remotely sensed data, as well as multivariate, relatively and absolutely inhomogeneous, and sparse data

Suggested Citation:"5 DATA MANAGEMENT." National Research Council. 1994. GOALS (Global Ocean-Atmosphere-Land System) for Predicting Seasonal-to-Interannual Climate: A Program of Observation, Modeling, and Analysis. Washington, DC: The National Academies Press. doi: 10.17226/4811.
×

into coupled ocean–atmosphere–land models. The resulting data sets would also facilitate empirical studies of the predictability of the coupled system. Strong communication links and interoperability between major data centers and data-distribution centers could be required.

Suggested Citation:"5 DATA MANAGEMENT." National Research Council. 1994. GOALS (Global Ocean-Atmosphere-Land System) for Predicting Seasonal-to-Interannual Climate: A Program of Observation, Modeling, and Analysis. Washington, DC: The National Academies Press. doi: 10.17226/4811.
×
This page in the original is blank.
Suggested Citation:"5 DATA MANAGEMENT." National Research Council. 1994. GOALS (Global Ocean-Atmosphere-Land System) for Predicting Seasonal-to-Interannual Climate: A Program of Observation, Modeling, and Analysis. Washington, DC: The National Academies Press. doi: 10.17226/4811.
×
Page 55
Suggested Citation:"5 DATA MANAGEMENT." National Research Council. 1994. GOALS (Global Ocean-Atmosphere-Land System) for Predicting Seasonal-to-Interannual Climate: A Program of Observation, Modeling, and Analysis. Washington, DC: The National Academies Press. doi: 10.17226/4811.
×
Page 56
Suggested Citation:"5 DATA MANAGEMENT." National Research Council. 1994. GOALS (Global Ocean-Atmosphere-Land System) for Predicting Seasonal-to-Interannual Climate: A Program of Observation, Modeling, and Analysis. Washington, DC: The National Academies Press. doi: 10.17226/4811.
×
Page 57
Suggested Citation:"5 DATA MANAGEMENT." National Research Council. 1994. GOALS (Global Ocean-Atmosphere-Land System) for Predicting Seasonal-to-Interannual Climate: A Program of Observation, Modeling, and Analysis. Washington, DC: The National Academies Press. doi: 10.17226/4811.
×
Page 58
Suggested Citation:"5 DATA MANAGEMENT." National Research Council. 1994. GOALS (Global Ocean-Atmosphere-Land System) for Predicting Seasonal-to-Interannual Climate: A Program of Observation, Modeling, and Analysis. Washington, DC: The National Academies Press. doi: 10.17226/4811.
×
Page 59
Suggested Citation:"5 DATA MANAGEMENT." National Research Council. 1994. GOALS (Global Ocean-Atmosphere-Land System) for Predicting Seasonal-to-Interannual Climate: A Program of Observation, Modeling, and Analysis. Washington, DC: The National Academies Press. doi: 10.17226/4811.
×
Page 60
Next: 6 RELATIONSHIP OF GOALS TO OTHER PROGRAMS »
GOALS (Global Ocean-Atmosphere-Land System) for Predicting Seasonal-to-Interannual Climate: A Program of Observation, Modeling, and Analysis Get This Book
×
 GOALS (Global Ocean-Atmosphere-Land System) for Predicting Seasonal-to-Interannual Climate: A Program of Observation, Modeling, and Analysis
Buy Paperback | $40.00
MyNAP members save 10% online.
Login or Register to save!
Download Free PDF

This book lays out a science plan for a major, international, 15-year research program. The past 10 years have seen significant progress in studies of short-term climate variations, in particular for the region of the tropical Pacific Ocean and the El Nino/Southern Oscillation phenomenon. Some forecast skill with lead times as long as a year in advance has already been developed and put to use. The GOALS program plans to capitalize on this progress by expanding efforts on observations and seasonal-to-interannual predictions to the remainder of the tropics and to higher latitudes.

READ FREE ONLINE

  1. ×

    Welcome to OpenBook!

    You're looking at OpenBook, NAP.edu's online reading room since 1999. Based on feedback from you, our users, we've made some improvements that make it easier than ever to read thousands of publications on our website.

    Do you want to take a quick tour of the OpenBook's features?

    No Thanks Take a Tour »
  2. ×

    Show this book's table of contents, where you can jump to any chapter by name.

    « Back Next »
  3. ×

    ...or use these buttons to go back to the previous chapter or skip to the next one.

    « Back Next »
  4. ×

    Jump up to the previous page or down to the next one. Also, you can type in a page number and press Enter to go directly to that page in the book.

    « Back Next »
  5. ×

    Switch between the Original Pages, where you can read the report as it appeared in print, and Text Pages for the web version, where you can highlight and search the text.

    « Back Next »
  6. ×

    To search the entire text of this book, type in your search term here and press Enter.

    « Back Next »
  7. ×

    Share a link to this book page on your preferred social network or via email.

    « Back Next »
  8. ×

    View our suggested citation for this chapter.

    « Back Next »
  9. ×

    Ready to take your reading offline? Click here to buy this book in print or download it as a free PDF, if available.

    « Back Next »
Stay Connected!