Summary
BACKGROUND AND TASK
Since 1959, the National Institute of Standards and Technology (NIST) has annually commissioned the National Academies of Sciences, Engineering, and Medicine to assess its various measurements and standards laboratories. Presently, there are six such laboratories in operation. In the fiscal year 2023, NIST enlisted the Laboratory Assessments Board of the National Academies to appraise the Physical Measurement Laboratory (PML). This document encompasses the assessment provided by the Panel on Assessment of the National Institute of Standards and Technology (NIST) Physical Measurement Laboratory for four divisions of PML situated at the NIST Boulder campus—namely, the Applied Physics Division, the Time and Frequency Division, the Quantum Electromagnetics Division, and the Quantum Physics Division. Complementary assessments are available for the Material Measurement Laboratory and the NIST Center for Neutron Research, each in their respective companion reports (NASEM 2023, 2024). This assessment encompassed an onsite visit by the panel, featuring comprehensive laboratory tours, one-on-one interactions with PML researchers, and subsequent inquiries post-visit. After this, the panel used its combined experience and expertise to appraise PML in alignment with the statement of task (presented in Chapter 1) and to formulate recommendations accordingly. The divisions assessed in this report were last evaluated in 2018 (NASEM 2018).
The statement of task encompasses four primary components. The panel’s foremost objective is to assess PML’s technical programs, comparing the caliber of research at PML with similar international programs, and determining whether PML’s programs adequately align with its objectives. Secondly, the panel is tasked with assessing the range of scientific and technical expertise available within PML, gauging its global standing, and evaluating its effectiveness in supporting both PML’s technical initiatives and its overall objective attainment. Thirdly, a scrutiny of PML’s budget, facilities, equipment, and Human Resources is required, including an examination of how effectively these components bolster PML’s technical endeavors and contribute to the fulfillment of its goals. Lastly, the panel is to assess the efficacy of PML’s methods for disseminating the products of its work. This encompasses an assessment of the extent to which PML’s work is driven by the needs of stakeholders, the comprehensiveness and effectiveness of dissemination and technology transfer mechanisms, and the adequacy of PML’s monitoring of stakeholder utilization and the impact derived from PML’s outputs.
Physical Measurement Laboratory
PML comprises nine separate divisions, each devoted to a particular aspect of measurement science and technology. This report is focused on the four PML divisions located in Boulder: Applied Physics, Quantum Physics, Quantum Electromagnetics, and Time and Frequency. These divisions engage in research and development of almost every type of measurement science used industrially and for research. They also provide NIST-traceable calibrations and develop standards and best practices. These divisions have strong ties to industry, universities, professional and standards setting organizations, and other agencies of government (NIST 2022).
OVERARCHING THEMES AND KEY RECOMMENDATIONS
The panel organized itself into four largely independent sub-panels to assess the divisions included in this report in parallel, one sub-panel aligned with each division being assessed. In the course of their work, three overarching themes emerged that apply to all of PML. These are the adequacy of facilities and equipment, adequacy of staffing, and safety posture. For each of these themes, the panel offered a key recommendation that applies to most of the divisions.
Adequacy of Facilities and Equipment
Each of the four sub-panels identified facilities and infrastructure as a crucial area to address. The 2018 report that assessed the PML division and Boulder, and the more recent 2023 National Academies’ report Technical Assessment of the Capital Facility Needs of the National Institute of Standards and Technology (NASEM 2023b; the “Capital Facility Needs report”) both highlight the aging facilities and infrastructure that present severe impediments to PML research staff continuing to produce the high quality of work that they are known for. Of particular note, the 2023 report found that NIST research staff are devoting 10 to 40 percent of their time on workarounds and do-it-yourself repairs. This comes at the cost of research time and may impact PML’s status as a world-leading institution, along with its ability to attract high-quality talent.
For the Applied Physics Division, the sub-panel identified the electrical supply and the water system as particular areas in need of upgrades. The Quantum Physics Division sub-panel pointed to serious space and infrastructure problems at JILA. The Quantum Electromagnetics Division sub-panel identified renovations and improvements to the division’s device fabrication facility as a priority. The Time and Frequency Division sub-panel called out improvements in Building 01 and the mitigation of power outages in multiple buildings as hindering progress.
Key Recommendation 1: The Physical Measurement Laboratory (PML) should work with the National Institute of Standards and Technology’s Office of Facilities and Property Management to identify facilities and infrastructure with critical infrastructure issues. Infrastructure and facilities that are critical in supporting the scientific mission of PML should be considered in assessing remodeling and upgrading needs.
Adequacy of Staffing
Attention needs to be paid to staffing, both now and in the future. Several programs currently have insufficient staffing levels, and retirements could lead to a loss of knowledge and expertise unless effective succession plans are put in place. The sub-panel that reviewed the Quantum Electromagnetics Division identified the Spin Electronics Group as needing additional personnel and resources. It also recommended that this group consider succession plans to close experience gaps. Similarly, the sub-panel evaluating the Time and Frequency Division recommended the development of succession plans and furthermore called for knowledge and responsibilities to be shared and distributed among members and teams to guarantee that knowledge was preserved if key members left. That sub-panel was also concerned about inadequate staffing, in particular for the division’s time distribution service. The Applied Physics Division sub-panel emphasized the importance of addressing personnel issues in a timely fashion and, to that end, recommended that PML ensure that the division has one or more excellent Human Resources professionals onsite.
Key Recommendation 2: The Physical Measurement Laboratory should act to ensure adequate staffing at the four divisions now and for the future and, as part of that, should work to improve the ways it addresses personnel issues. This would include having an excellent Human
Resources professional(s) onsite who can address an array of personnel issues in a timely fashion within the context of the PML culture.
Key Recommendation 3: The Physical Measurement Laboratory should establish clear and open policies and practices across the organization on recruiting permanent government employee positions and promoting interactions and collaborations. In particular, the open positions should be made available to staff and guest researchers across the organization. National Institute of Standards and Technology–wide seminars and activities should be established to promote inter-group interactions and collaborations.
Safety Posture
The safety posture of PML does not adequately ensure the safety of PML staff and visitors. Initial steps to improve safety have been taken by PML staff, but improvements need to accelerate. Safety inspections and standards need to be reevaluated with the goal of bringing safety across the divisions to a level that is comparable with major industrial companies. The sub-panel that reviewed the Applied Physics Division recommended that the frequency of safety inspections be increased and that the PML leadership should reach out to major industrial companies for advice on improving laboratory safety. The Quantum Physics Division sub-panel identified laser safety as a particular concern and recommended that NIST and the University of Colorado Boulder jointly establish a clear and aggressive timeline for meeting American National Standards Institute laser safety standards.
Key Recommendation 4: The Physical Measurement Laboratory should address persistent safety concerns related to safety inspections and standards, particularly within the Applied Physics Division and the Quantum Physics Division.
REFERENCES
NASEM (National Academies of Sciences, Engineering, and Medicine). 2018. An Assessment of Four Divisions of the Physical Measurement Laboratory at the National Institute of Standards and Technology: Fiscal Year 2018. Washington, DC: The National Academies Press. https://doi.org/10.17226/25281.
NASEM. 2023a. An Assessment of the Materials Measurement Laboratory at the National Institute of Standards and Technology: Fiscal Year 2023. Washington, DC: The National Academies Press. https://doi.org/10.17226/26048.
NASEM. 2023b. Technical Assessment of the Capital Facility Needs of the National Institute of Standards and Technology. Washington, DC: The National Academies Press. https://doi.org/10.17226/26684.
NASEM. 2024. An Assessment of the National Institute of Standards and Technology Center for Neutron Research: Fiscal Year 2023. Washington, DC: The National Academies Press.
NIST (National Institute of Standards and Technology). 2022. “Physical Measurement Laboratory: Gauging Nature on All Scales.” https://www.nist.gov/system/files/documents/2022/01/21/pmlbrochure.pdf.