Suggested Citation:"Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2022. Understanding the Quality of the 2020 Census: Interim Report. Washington, DC: The National Academies Press. doi: 10.17226/26529.
×
B
Public Meeting Agendas
MEETING 1, JULY 2021
Day 1: Monday, July 19, 2021
| 12:00pm | Introduction to the Panel to Evaluate the Quality of the 2020 Census |
| Call to Order, and Introductions | |
| 10 |
TERESA SULLIVAN, Chair, University of Virginia |
| Welcome from U.S. Census Bureau, and Sponsor’s Expectations for the Study: The Importance of Data Quality | |
| 30 |
RON JARMIN, Acting Director, U.S. Census Bureau |
| Welcome from the National Academies, and Introduction to the Panel Process | |
| 15 |
MARY ELLEN O’CONNELL, Division of Behavioral and Social Sciences and Education |
| 5 |
BRIAN HARRIS-KOJETIN, Committee on National Statistics |
| 1:00pm | Overview of Operations and Challenges in the 2020 Census |
| 60 |
ALBERT FONTENOT, U.S. Census Bureau |
| 2:00pm | Road Map: Tools for Assessing the Quality of the 2020 Census |
| 15 |
DEBORAH STEMPOWSKI, U.S. Census Bureau |
| 2:15pm | Break |
Suggested Citation:"Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2022. Understanding the Quality of the 2020 Census: Interim Report. Washington, DC: The National Academies Press. doi: 10.17226/26529.
×
| 2:30pm | Assessments of Census Quality: Internal to Census |
| Postenumeration Survey | |
| 30 |
PATRICK CANTWELL AND TIMOTHY KENNEL, U.S. Census Bureau |
| Operational Assessments and Evaluations | |
| 30 |
JENNIFER REICHERT AND JOAN HILL, U.S. Census Bureau |
| 3:30pm | Role of Advertising and Communications in Data Quality in the 2020 Census |
| 30 |
KATHLEEN STYLES, U.S. Census Bureau |
| 4:00pm | General Discussion/Q&A of Day 1 Topics |
| 4:30pm | Planned Adjournment of Day 1 |
Day 2: Tuesday, July 20, 2021
| 12:00pm | Assessments of Census Quality: Independent of Census |
| Call to Order, and Introductions | |
| 10 |
TERESA SULLIVAN, Chair, University of Virginia |
| Demographic Analysis and Population Estimates | |
| 30 |
CHRISTINE HARTLEY AND ERIC JENSEN, U.S. Census Bureau |
| 12:40pm | Building Quality in Census Operations and Systems |
| Field Data Collection Quality Assurance (Field Structure, Operational Control System, Quality Assurance and Reinterview Operations) | |
| 65 |
TAMARA ADAMS AND RJ MARQUETTE, U.S. Census Bureau |
| 1:45pm | Break |
| 2:00pm | Building Quality in Census Operations and Systems (continued) |
| Monitoring Systems in 2020 (Decennial Field Quality Monitoring, Real-Time Analysis of Data, and Unified Tracking System Reports) | |
| 60 |
RICHARD DENBY, SARAH KONYA, AND DOMINIC BEAMER, U.S. Census Bureau |
| Nonresponse Followup Contact Strategy in 2020 | |
| 45 |
DOMINIC BEAMER, U.S. Census Bureau |
| Administrative Records Usage in 2020 |
Suggested Citation:"Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2022. Understanding the Quality of the 2020 Census: Interim Report. Washington, DC: The National Academies Press. doi: 10.17226/26529.
×
| 45 |
THOMAS MULE, U.S. Census Bureau |
| 4:25pm | General Discussion/Q&A of Day 2 Topics |
| 5:00pm | Planned Adjournment of Day 2 |
Day 3: Wednesday, July 21, 2021
| 12:00pm | After the Field: Reconciling Data Quality |
| Call to Order, and Introductions | |
|
TERESA SULLIVAN, Chair, University of Virginia |
|
| Stages and Challenges in Post-Data Collection Processing | |
| 60 |
BARBARA LOPRESTI, U.S. Census Bureau |
| Data Reasonableness Reviews | |
| 45 |
JASON DEVINE AND CHRISTINE FLANAGAN BORMAN, U.S. Census Bureau |
| 1:45pm | Break |
| 2:00pm | After the Field: Reconciling Data Quality (continued) |
| Count Imputation, Item Nonresponse, and Characteristic Imputation | |
| 60 |
PATRICK CANTWELL, TIMOTHY KENNEL, AND CHRISTINE FLANAGAN BORMAN, U.S. Census Bureau |
| 3:00pm | Back to the Beginning: Frame Development |
| Revised Approaches to Address Canvassing and Frame Development in 2020 | |
| 45 |
FRANK MCPHILLIPS AND ANDREA JOHNSON, U.S. Census Bureau |
| 3:45pm | General Discussion/Q&A of Day 2 Topics |
| 4:15pm | Planned Adjournment of Day 3 |
MEETING 2, AUGUST 2021
Day 1: Monday, August 30, 2021
| 12:30pm | Call to Order, and Introductions |
| 10 |
TERESA SULLIVAN, Chair, University of Virginia |
Suggested Citation:"Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2022. Understanding the Quality of the 2020 Census: Interim Report. Washington, DC: The National Academies Press. doi: 10.17226/26529.
×
| 12:40pm | Overview of the Development of the Internet Response System |
| Presentation to include (a) prehistory of Internet response in the 2010 and earlier censuses (e.g, the limited use in the 2000 Census and the deployment of Internet response using Centurion in major Census Bureau surveys), (b) planning, testing, and development during the 2010s of the technical systems to implement Internet response (more from a systems/capacity standpoint than specific time-and-yield differences between different reminder cues), (c) overview of how the Internet response channel functioned (or was planned to work in 2020) — including, importantly, the late decision to switch to Primus as the data collection platform — understanding that little can be said about effectiveness/quality of the systems until the Bureau’s assessment is complete, and (d) again absent assessment results, initial clear takeaways or directions for 2030. | |
| 60 |
KRISTEN HEARNS, U.S. Census Bureau |
| 1:40pm | Overview of Non-ID Processing |
| Presentation to include (a) prehistory of Non-ID Processing in the 2010 and earlier censuses (e.g, the historical “Be Counted” model and other instances in which questionnaires entered processing without pre-assigned Master Address File IDs), (b) planning, testing, and development during the 2010s of the technical systems to implement Non-ID Processing, (c) overview of how it functioned (or was planned to work) in 2020, understanding that little can be said about effectiveness/quality of the systems until the Bureau’s assessment is complete, and (d) again absent assessment results, initial clear takeaways or directions along Non-ID lines for 2030. | |
| 60 |
DANIEL DONELLO, U.S. Census Bureau |
| 2:40pm | Break |
| 3:00pm | Roundtable Discussion: Lessons Learned and Suggested Improvements for 2030 from 2020 Census Field Staff |
Suggested Citation:"Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2022. Understanding the Quality of the 2020 Census: Interim Report. Washington, DC: The National Academies Press. doi: 10.17226/26529.
×
| Informal discussion involving a small group of 2020 Census enumerators, field operations supervisors, and Area Census Office personnel, identified through the Census Bureau’s Field Division. This discussion is meant be evocative and preliminary, including a mix of geographic locations and staff positions but not intended to be a comprehensively representative canvass of the field experience. We anticipate that the staff members will take a few moments to introduce themselves and their role in the 2020 Census (and any previous censuses), before a general Q&A/discussion with the panel, including: (a) preparedness for the job and thoughts on the effectiveness of training, (b) experience with enumerator/supervisor communication processes in 2020 and the utility of automated alerts, (c) functionality of the technology for enumerator case assignment, data collection, and payroll information collection, (d) level of interaction, if any, between enumerators/supervisors and the area or regional census management, including partnership activities; (e) insights on the changes (and communication thereof) in operations made on the fly in response to the pandemic, wildfires, and other situations, and (f) suggestions for improvements in 2030, including the balance of decentralized vs. “brick and mortar” presence and staff support at the area and regional levels. | |
|
ROBERT (BOB) LEIBOWITZ, Area Census Office Manager (ACOM) in Maine; Regional Technician for Update/Leave and Update/Enumerate; Area Manager for Nonresponse Follow-Up (NRFU); currently on Post-Enumeration Survey (PES) [New York Region] |
|
|
ROBERT (BOB) LEE, Census Field Manager (CFM) and Lead Census Field Manager (LCFM) in Queens, New York; Area Manager for Peak Operations; currently on PES [New York Region] |
|
|
JON HALLINGSTAD, ACOM; currently a Regional Survey Manager (RSM) [Philadelphia Region] |
|
|
ROBERT TOTH, ACOM; currently Regional Technician on PES [Philadelphia Region] |
|
| 90 |
DIANA HARRIS CANNON, CFM and ACOM; currently an RSM for American Housing Survey [Atlanta Region] |
| 4:30pm | Discussion/Q&A on Day 1 Topics |
| 4:45pm | Planned Adjournment of Day 1 |
Suggested Citation:"Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2022. Understanding the Quality of the 2020 Census: Interim Report. Washington, DC: The National Academies Press. doi: 10.17226/26529.
×
Day 2: Tuesday, August 31, 2021
| 12:30pm | Call to Order, and Introductions |
| 10 |
TERESA SULLIVAN, Chair, University of Virginia |
| 12:40pm | Chronology of 2020 Census Field Collection Deadlines |
| Follow-up to presentations at Meeting 1, to a more detailed articulation of the major field collection operational dates during 2020, from the Bureau’s perspective: as planned ahead of time, as adjusted for COVID and contingencies, and as subsequently revised to try to meet statutory requirements and comply with legal decisions. This should also include whether and how interim dates within enumeration and nonresponse follow-up operations were readjusted based on new end targets (e.g., how specified “dates certain” for areas/cases being deemed eligible for proxy or closeout were realigned). | |
| 60 |
ALBERT FONTENOT, U.S. Census Bureau |
| 1:40pm | Deeper Dive on the 2020 Census Program of Experiments and Evaluations (CPEX) |
| Follow-up to presentation at Meeting 1, to include (a) capsule descriptions of the major 2030-facing experiments, particularly those involving use of administrative records and (b) an updated list of the planned operational assessments within CPEX and a clearer sense of additions/deletions/adjustments to the CPEX slate since late 2018. This discussion will not include the results of any evaluation or assessment that has not yet been completed by the Census Bureau. | |
| 60 |
JENNIFER REICHERT AND JOAN HILL, U.S. Census Bureau |
| 2:40pm | Break |
| 3:00pm | Overview of Group Quarters Enumeration |
Suggested Citation:"Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2022. Understanding the Quality of the 2020 Census: Interim Report. Washington, DC: The National Academies Press. doi: 10.17226/26529.
×
| Presentation to include (a) recap of major features of group quarters enumeration in the 2010 Census, (b) planning, testing, and development during the 2010s of the technical systems to handle group quarters (including major GQ-related changes to the census Residence Rule and concepts for 2020 and what if anything was done during the preceding decade in terms of GQ frame development), (c) overview of how group quarters enumeration functioned (or was planned to work in 2020) — including continuing discussion from Meeting 1 of the phone recontact with group quarters — understanding that little can be said about effectiveness/quality of the systems until the Bureau’s assessment is complete, and (d) again absent assessment results, initial clear takeaways or directions for 2030. | |
| 60 |
JUDY BELTON AND DORA DURANTE, U.S. Census Bureau |
| 4:00pm | Discussion/Q&A on Day 2 Topics |
| 4:30pm | Planned Adjournment of Day 2 |
MEETING 3, SEPTEMBER 2021
Day 1: Tuesday, September 28, 2021
| 12:30pm | Call to Order, and Introductions |
| 5 |
TERESA SULLIVAN, Chair, University of Virginia |
| 12:35pm | Changes to Race and Ethnicity Coding in the 2020 Census |
| Building off of material presented accompanying the August 2021 release of P.L. 94-171 data in legacy file format, presentation to include (a) background on coding of race and ethnicity information in 2010; (b) planning, testing, and development during the 2010s of race/ethnicity items and coding; (c) overview of how the coding was done in 2020; and (d) absent assessment results, any clear directions for 2030 resulting from this work. | |
| 55 |
NICHOLAS JONES, ROBERTO RAMIREZ, AND RACHEL MARKS, U.S. Census Bureau |
| 1:40pm | Census Budget and Possible Impact of Budget Reductions |
Suggested Citation:"Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2022. Understanding the Quality of the 2020 Census: Interim Report. Washington, DC: The National Academies Press. doi: 10.17226/26529.
×
| In the presentations at the first two meetings and from other context, we have heard about various points from 2015 onward in which scale or extent of operations or tests had to be reframed on cost concerns (e.g., the cutback in sites for the End-to-End Census Test, the discontinuance of Active Block Resolution in In-Office Address Canvassing). The panel would like to hear more about these various budgetary forks-in-the-road, any rough conjecture of what was lost, and whether/how capabilities that were set aside might be picked up again for 2030. | |
| 55 |
AL FONTENOT AND BEN TAYLOR, U.S. Census Bureau |
| 2:40pm | Break |
| 3:00pm | Disclosure Avoidance in the 2020 Census |
| Much has already been said in other forums about differential privacy and the TopDown Algorithm as it has been applied to the redistricting data. This presentation should include some of that material and rationale, but the hope is that it should build from and extend the presentation that seems likely to occur with the Census Scientific Advisory Committee on 9/24—focusing attention on extant work and initial directions for disclosure avoidance in the 2020 Demographic and Housing Characteristics and other data products beyond the P.L. 94-171 release. | |
| 60 |
MICHAEL HAWES AND CYNTHIA DAVIS HOLLINGSWORTH, U.S. Census Bureau |
| 4:00pm | Discussion/Q&A on Day 1 Topics |
| 4:30pm | Planned Adjournment of Day 1 |
Day 2: Wednesday, September 29, 2021
| 12:30pm | Call to Order, and Introductions |
| 5 |
TERESA SULLIVAN, Chair, University of Virginia |
| 12:35pm | Report of the American Statistical Association (ASA) Task Force on Census Quality Indicators |
Suggested Citation:"Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2022. Understanding the Quality of the 2020 Census: Interim Report. Washington, DC: The National Academies Press. doi: 10.17226/26529.
×
| The American Statistical Association’s Task Force on Census Quality Indicators released its report on state-level 2020 Census apportionment numbers on September 14, 2021. Panel members Thomas Louis and Matthew Snipp and panel staff Constance Citro are also members of the ASA Task Force, and panel member Joseph Salvo served on the task force’s research team. | |
|
NANCY A. POTOK, Independent Consultant and Co-Chair, ASA Task Force |
|
| 60 |
JOHN H. THOMPSON, Biocomplexity Institute and Initiative, University of Virginia, and ASA Task Force |
| 1:35pm | Overview of Update/Leave and Update/Enumerate Operations |
| Continuing series of operational overviews, presentation to include (a) ways in which Update/Leave and Update/Enumerate was used in 2010 and earlier censuses; (b) planning, testing, and development during the 2010s related to U/L and U/E; (c) overview of how these types of enumeration worked (or were planned to work) in 2020 and the impacts of the pandemic or other disruptions, including impacts of Area Census Office closing and reopening in heavy U/E and U/L areas; and (d) absent assessment results, any initial clear takeaways or directions for 2030. | |
| 60 |
JULIA LOPEZ, U.S. Census Bureau |
| 2:30pm | Break |
| 2:45pm | National Processing Center |
| Like the other operational overviews heard by the panel but broader than a single census operation, this is meant to be an opportunity for staff/leadership of the Census Bureau’s National Processing Center (NPC) in Jeffersonville, Indiana, to describe and discuss: (a) overview of decennial and non-decennial operations at NPC; (b) description of what changes in mobilization/capacity were made in 2010; (c) the planned role for NPC in the 2020 Census and development of support systems during the 2010s; (d) adapting to the pandemic, adapting workflows, and other major challenges in 2020; and (e) legacies of 2020 and initial directions for 2030. [This could also include discussion of pandemic/workflow adjustments at other contracted 2020 Census locations, such as the other paper data capture centers and telephone call centers.] | |
| 60 |
LEANNA MAYO AND RITA SCHULER, U.S. Census Bureau |
Suggested Citation:"Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2022. Understanding the Quality of the 2020 Census: Interim Report. Washington, DC: The National Academies Press. doi: 10.17226/26529.
×
| 3:45pm | Overview of Census Questionnaire Assistance and Coverage Improvement Interviewing |
| Continuing the series of operational overviews, presentation to include (a) ways in which phone-based operations were used in 2010 and earlier censuses; (b) planning, testing, and development during the 2010s of phone-based interviewing and response; (c) overview of how these operations worked (or were planned to work) in 2020 and the impacts of the pandemic or other disruptions; and (d) absent assessment results, any initial clear takeaways or directions for 2030. | |
| 60 |
KEVIN ZAJAC AND MARY FRANCES ZELENAK, U.S. Census Bureau |
| 4:45pm | Discussion/Q&A on Day 2 Topics |
| 5:00pm | Planned Adjournment of Day 2 |
MEETING 4, NOVEMBER 2021
Day 1: Tuesday, November 16, 2021
| 12:30pm | Call to Order, and Introductions |
| 5 |
TERESA SULLIVAN, Chair, University of Virginia |
| 12:35pm | Update on the Postenumeration Survey (PES) |
| The panel received an overview on the PES in Meeting 1 in July; this is a deeper dive on the conduct, current status, and plans for the PES, and the unique challenges of fielding and conducting the PES in this census. The presentation should also include discussion of how the PES team is grappling with the question of the effect of delay of response on the accuracy of response. | |
| 60 |
JUDY BELTON AND TIMOTHY KENNEL, U.S. Census Bureau |
| 1:35pm | Overview of the Data Stewardship Executive Policy (DSEP) Committee and Its Processes |
| The composition and operations of DSEP are not well known publicly, and the objective of this session is to have a concise summary of DSEP and its role in governing disclosure avoidance procedures and the release of information outlined for the record. In particular, the panel would like to hear a rationale for releasing or not releasing census operational and quality metrics at various levels of geography. | |
| 60 |
MONIQUE ELEBY, U.S. Census Bureau |
Suggested Citation:"Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2022. Understanding the Quality of the 2020 Census: Interim Report. Washington, DC: The National Academies Press. doi: 10.17226/26529.
×
| 2:35pm | Break |
| 2:50pm | Overview of Census Partnership Operations in the 2020 Census |
| Partnership activities were a critical part of census operations, particularly given the challenging circumstances of the 2020 count. This operational overview is akin to those on other census operations in Meetings 1–3: a brief description of how partnerships were handled in 2010 and earlier, a description of what was planned for 2020, an emphasis on how things shifted and operations were actually conducted during 2020, and—absent any evaluation results as yet—clear or known directions for partnership activities in building to 2030. | |
| 40 |
ROBIN BACHMAN AND WILLETTE ALLEN, U.S. Census Bureau |
| 3:30pm | Roundtable Discussion: Stakeholder and Partner Initial Impressions of the Quality of the 2020 Census |
| During Meeting 1, the panel invited public comment on its charge. Now that the first major release of 2020 Census data has been accomplished (the P.L. 94-171 redistricting data) and plans develop for subsequent releases, the panel is inviting a selection of census stakeholders and partners to discuss their initial impressions of the quality of the 2020 Census with the panel. We anticipate that the invitees will have up to 10 minutes for opening remarks before the floor is opened for general discussion/Q&A with the panel. | |
|
BILL O’HARE, O’Hare Data and Demographic Services |
|
|
SUSAN BROWER, Minnesota State Demographer and 2020 Census partnership coordinator for the state of Minnesota |
|
|
ERIC GUTHRIE, Minnesota State Demographic Center (since May 2021) and formerly Michigan State Demographer |
|
|
KIMBALL BRACE, Election Data Services, Inc. |
|
|
CLARK BENSEN, POLIDATA Political Data Analysis |
|
| 90 |
GWYNNE EVANS-LOMAYESVA, National Congress of American Indians |
| 5:00pm | Planned Adjournment of Day 1 |
Suggested Citation:"Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2022. Understanding the Quality of the 2020 Census: Interim Report. Washington, DC: The National Academies Press. doi: 10.17226/26529.
×
This page intentionally left blank.
