National Academies Press: OpenBook
« Previous: Appendix A: Statement of Task
Suggested Citation:"Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press. doi: 10.17226/27092.
×

B

Public Meeting Agendas

APRIL 22, 2022
KICK-OFF MEETING DAY 1

Executive Session

3:00–3:05 PM Welcome and Introductions
3:05–4:00 PM Bias and Conflict of Interest Discussion
Scott Weidman, Deputy Executive Director, Division on Engineering and Physical Sciences

Open Session

4:00–5:00 PM Sponsor Remarks
Major General Evan Dertien, Commander, Air Force Test Center
Colonel Keith Roessig, Vice Commander, Air Force Test Center
Air Force Test Center Technical Experts
5:00 PM Adjourn
Suggested Citation:"Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press. doi: 10.17226/27092.
×

APRIL 25, 2022
KICK-OFF MEETING DAY 2

Executive Session

11:00 AM–1:00 PM Bias and Conflict of Interest Discussion

JUNE 27, 2022
DATA-GATHERING WORKSHOP, DAY 1

Room 208
The Keck Center, 500 Fifth Street, NW
Washington, DC 20001

11:00–11:15 AM Workshop Welcome and Introductions
11:15 AM–12:00 PM Speaker: Mr. Jacob Martinez, Technical Director, 47th Cyberspace Test Squadron, United States Air Force
12:00–12:45 PM Speaker: Mr. David Coppler, Technical Director, 46 Test Squadron, United States Air Force
12:45–1:15 PM Lunch Break
1:15–2:00 PM Speaker: Mr. Marshall Kendrick, 45th Test Squadron, United States Air Force
2:00–2:45 PM Speaker: Dr. Jane Pinelis, Chief, AI Assurance, Office of the Department of Defense Chief Digital and Artificial Intelligence Officer (CDAO)
2:45–3:15 PM Discussion and Day 1 Wrap-Up
3:15 PM Adjourn
Suggested Citation:"Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press. doi: 10.17226/27092.
×

JUNE 28, 2022
DATA-GATHERING WORKSHOP, DAY 2

Room 208
The Keck Center, 500 Fifth Street, NW
Washington, DC 20001

11:00–11:15 AM Welcome and Recap of Day 1
11:15 AM–12:00 PM Speaker: Dr. Chad Bieber, Director, T&E Operations, Joint AI Center, Johns Hopkins University Applied Physics Laboratory
12:00–12:30 PM Discussion: Workshop Day 1 and Future Committee Meetings
12:30–1:15 PM Lunch Break
1:15–2:00 PM Speaker: Olivia Brown, Technical Staff, AI Technology Group, MIT Lincoln Laboratory
2:00–2:45 PM Speaker: Dr. Michael Wellman, Richard H. Orenstein Division Chair of Computer Science and Engineering and Lynn A. Conway Collegiate Professor of Computer Science and Engineering, University of Michigan
2:45–3:00 PM Break
3:00–3:45 PM Speaker: Dr. Thomas Strat, President and CEO, DZYNE Technologies
3:45–4:30 PM Speaker: Jim Bellingham, Executive Director, Johns Hopkins Institute for Assured Autonomy
4:30–4:45 PM Break
4:45–5:30 PM Speaker: Dr. Matt Turek, Deputy Director Information Innovation Office
Suggested Citation:"Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press. doi: 10.17226/27092.
×
5:30–6:15 PM Speaker: Dr. Nancy Cooke, Professor and Graduate Program Chair in Human Systems Engineering, Polytechnic School, Arizona State University
6:15–6:30 PM Discussion and Day 2 Wrap-Up
6:30 PM Adjourn

JUNE 28, 2022
DATA-GATHERING WORKSHOP, DAY 3

Room 208
The Keck Center, 500 Fifth Street, NW
Washington, DC 20001

11:00–11:05 AM Welcome and Recap of Day 2
11:05–11:50 AM Speaker: Dr. Bin Yu (NAS), Chancellor’s Professor in the Departments of Statistics and Electrical Engineering & Computer Sciences, University of California, Berkeley
11:50 AM–12:35 PM Speaker: Dr. Nathan VanHoudnos, Senior Machine Learning Research Scientist, Software Engineering Institute
12:35–1:15 PM Lunch Break
1:15–2:00 PM Speaker: Dr. Bruce Draper, Program Manager, Defense Advanced Research Projects Agency
2:00–2:45 PM Speaker: Mr. Ed Zelnio, Principal Research Physicist, Air Force Research Laboratory
2:45–3:00 PM Break
3:00–3:45 PM Speaker: Dr. Eileen Bjorkman, Executive Director, Air Force Test Center
3:45–4:30 PM Workshop Wrap-Up and Discussion
4:30 PM Adjourn
Suggested Citation:"Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press. doi: 10.17226/27092.
×

AUGUST 23, 2022
DATA-GATHERING MEETING #2

11:00–11:10 AM Welcome, Introductions, and Quick Updates
11:10 AM–12:10 PM Speaker: LCDR Joseph W. Geeseman, Program Manager, Smart Sensor, CDAO Algorithmic Warfare Division
12:10–12:45 PM Lunch Break
12:45–1:45 PM Speaker: Dr. Lori Westerkamp, Air Force Research Laboratory Sensors Directorate
1:45–2:00 PM Break
2:00–3:00 PM Speaker: Dr. John Richards, Sandia National Laboratories
3:00–4:30 PM Committee Discussion: Draft Report Outline, September Meeting, Site Visits, Writing Assignments, Fall Meeting Schedule
4:30 PM Adjourn

SEPTEMBER 28, 2022
DATA-GATHERING MEETING #3, DAY 1

Open Session

11:00 AM–12:00 PM Speaker: Prof. Yolanda Gil, Senior Director for Major Strategic AI and Data Science Initiatives, Information Sciences Institute, University of Southern California
12:00–12:30 PM Lunch Break
12:30–1:30 PM Speaker: Professor Jeff Schneider, Research Professor, Carnegie Mellon University, Founding Member—Uber Advanced Technologies Group
Suggested Citation:"Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press. doi: 10.17226/27092.
×
1:30–2:30 PM Speaker: Dr. Mitch Crosswait, Director of Operational Test and Evaluation Deputy Director of Net-Centric, Space, and Missile Defense Systems
2:30–2:45 PM Break

Closed Session

2:45–4:30 PM Committee Writing Session/Discussion
4:30 PM Adjourn

SEPTEMBER 29, 2022
DATA-GATHERING MEETING #3, DAY 2

Open Session

11:00 AM–12:00 PM Speaker: Mr. Eric Nelson, CTO of Software, Morse Corp.
12:00–12:30 PM Lunch Break
12:30–1:30 PM Speaker: Mr. Neil Serebryany, Founder and CEO, CalypsoAI
1:30–1:45 PM Break

Closed Session

1:45–4:00 PM Committee Writing Session/Discussion
4:00 PM Adjourn

NOVEMBER 30, 2022
DATA-GATHERING MEETING #4

1:00–2:00 PM Speaker: Dr. Riccardo Mariani, VP, Industry Safety, NVIDIA Italy
2:00–3:00 PM Committee Discussion, Planning, and Writing Session
Suggested Citation:"Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press. doi: 10.17226/27092.
×
3:00–3:45 PM Speaker: Col. Tucker “Cinco” Hamilton, Chief of AI Test and Operations, Department of the Air Force Chief Data and AI Office & Commander, 96th Operations Group, Eglin Air Force Base
3:45–5:00 PM Committee Discussion, Planning, and Writing Session (continued)
5:00 PM Adjourn

DECEMBER 6, 2022
DATA-GATHERING MEETING #5, DAY 1

1:00–1:45 PM Committee Discussion: Finalizing Writing Assignments, January Writing Meeting Planning, Discussion of the Outline and Draft Sections
1:45–2:45 PM Speaker: Dr. Nicholas Carlini, Research Scientist, Google Brain
2:45–3:00 PM Break
3:00–4:00 PM Speakers: Alex Kotran, Co-Founder and CEO, AI Education Project & Michael Kanaan, Chief of Staff of the U.S. Air Force Fellow at Harvard Kennedy School, AI Education Project Board Member
4:00 PM Adjourn

DECEMBER 7, 2022
DATA-GATHERING MEETING #5, DAY 2

12:30–1:30 PM Speaker: Michael Cox, Vice President and Chief Architect, NVIDIA
1:30–1:45 PM Break
1:45–2:30 PM Committee Discussion, Planning, and Writing Session
Suggested Citation:"Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press. doi: 10.17226/27092.
×
Page 142
Suggested Citation:"Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press. doi: 10.17226/27092.
×
Page 143
Suggested Citation:"Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press. doi: 10.17226/27092.
×
Page 144
Suggested Citation:"Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press. doi: 10.17226/27092.
×
Page 145
Suggested Citation:"Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press. doi: 10.17226/27092.
×
Page 146
Suggested Citation:"Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press. doi: 10.17226/27092.
×
Page 147
Suggested Citation:"Appendix B: Public Meeting Agendas." National Academies of Sciences, Engineering, and Medicine. 2023. Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force. Washington, DC: The National Academies Press. doi: 10.17226/27092.
×
Page 148
Next: Appendix C: Committee Member Biographical Information »
Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force Get This Book
×
 Test and Evaluation Challenges in Artificial Intelligence-Enabled Systems for the Department of the Air Force
Buy Paperback | $42.00 Buy Ebook | $33.99
MyNAP members save 10% online.
Login or Register to save!
Download Free PDF

The Department of the Air Force (DAF) is in the early stages of incorporating modern artificial intelligence (AI) technologies into its systems and operations. The integration of AI-enabled capabilities across the DAF will accelerate over the next few years.

At the request of DAF Air and Space Forces, this report examines the Air Force Test Center technical capabilities and capacity to conduct rigorous and objective tests, evaluations, and assessments of AI-enabled systems under operational conditions and against realistic threats. This report explores both the opportunities and challenges inherent in integrating AI at speed and at scale across the DAF.

READ FREE ONLINE

  1. ×

    Welcome to OpenBook!

    You're looking at OpenBook, NAP.edu's online reading room since 1999. Based on feedback from you, our users, we've made some improvements that make it easier than ever to read thousands of publications on our website.

    Do you want to take a quick tour of the OpenBook's features?

    No Thanks Take a Tour »
  2. ×

    Show this book's table of contents, where you can jump to any chapter by name.

    « Back Next »
  3. ×

    ...or use these buttons to go back to the previous chapter or skip to the next one.

    « Back Next »
  4. ×

    Jump up to the previous page or down to the next one. Also, you can type in a page number and press Enter to go directly to that page in the book.

    « Back Next »
  5. ×

    Switch between the Original Pages, where you can read the report as it appeared in print, and Text Pages for the web version, where you can highlight and search the text.

    « Back Next »
  6. ×

    To search the entire text of this book, type in your search term here and press Enter.

    « Back Next »
  7. ×

    Share a link to this book page on your preferred social network or via email.

    « Back Next »
  8. ×

    View our suggested citation for this chapter.

    « Back Next »
  9. ×

    Ready to take your reading offline? Click here to buy this book in print or download it as a free PDF, if available.

    « Back Next »
Stay Connected!