National Academies Press: OpenBook

Quality Management for Digital Model–Based Project Development and Delivery (2025)

Chapter: APPENDIX F: TASK 8 METHODOLOGY REVIEW FEEDBACK

« Previous: APPENDIX E: TASK 8 METHODOLOGY REVIEW PACKET
Page 127
Suggested Citation:"APPENDIX F: TASK 8 METHODOLOGY REVIEW FEEDBACK." National Academies of Sciences, Engineering, and Medicine. 2025. Quality Management for Digital Model–Based Project Development and Delivery. Washington, DC: The National Academies Press. doi: 10.17226/29172.
×

APPENDIX F. TASK 8 METHODOLOGY REVIEW FEEDBACK

Participants were provided with a survey to capture feedback on testing the methodology proposed by the research team. A summary of the questions and responses is presented below:

  1. What is your role or what are your general responsibilities at your agency?
    • Previously a Designer, now a Project Manager
    • Designer
    • Project Manager
    • I am a bridge design engineer specialized in BIM. In some of the pilot projects, I am working with the bridge designer to implement The BIM Uses defined in BEP (BIM Execution Plan).
    • Designer, Project Manager, Digital Delivery Specialist
    • Designer
    • Bridge Designer
  2. Which agency do you represent?
    • Utah DOT
    • Utah DOT
    • CalTrans
    • Kimely-Horn – supporting UDOT, ADOT, and TxDOT
    • Kimely-horn & UDOT
    • CalTrans
Page 128
Suggested Citation:"APPENDIX F: TASK 8 METHODOLOGY REVIEW FEEDBACK." National Academies of Sciences, Engineering, and Medicine. 2025. Quality Management for Digital Model–Based Project Development and Delivery. Washington, DC: The National Academies Press. doi: 10.17226/29172.
×
  1. Which review type does your agency CURRENTLY HAVE a policy or procedure for?

The graph shows a horizontal axis with five labeled bars. The data given in the graph are as follows: Survey: 2; 3D model integrity: 1; 3D model standards: 2; Clash detection and spatial coordination: 1; Discipline design review: 2.

  1. Which review types is your agency DEVELOPING a policy or procedure for?

The graph shows a horizontal axis with five labeled bars. The data given in the graph are as follows: Survey: 1; 3D model integrity: 3; 3D model standards: 3; Clash detection and spatial coordination: 1; Discipline design review: 3.

  1. Which disciplines were included in the model you used to test the procedures?

The graph shows a horizontal axis with six labeled bars. The data given in the graph are as follows: Bridge: 2; Drainage: 1; Geotech: 1; Roadway: 2; Traffic: 1; Utilities: 1.

Page 129
Suggested Citation:"APPENDIX F: TASK 8 METHODOLOGY REVIEW FEEDBACK." National Academies of Sciences, Engineering, and Medicine. 2025. Quality Management for Digital Model–Based Project Development and Delivery. Washington, DC: The National Academies Press. doi: 10.17226/29172.
×
  1. Which reviews did you test?

The graph shows a horizontal axis with four labeled bars and five categories. The data given in the graph are as follows: Survey: 0; 3D model integrity: 2; 3D model standards: 2; Clash detection and spatial coordination: 1; Discipline design review: 1.

  1. Regarding the testing packet, please indicate your reaction to these statements.

The right side of the scale reads, Strongly agree. The left side of the scale reads, Strongly disagree. The data given in the graph are described as follows: I had enough time to read and digest the packet provided to me: 3.7, which appears closer to the right side of the scale than the left; I was able to test the review procedures as thoroughly as I wanted to: 3, about midway between the left and right sides of the scale; I understand how the review packet supports the research goals: 4, closer to the right side than the left.

  1. To what extent do you agree with these statements about CONSISTENCY of reviews?

The right side of the scale reads, Strongly agree. The left side of the scale reads, Strongly disagree. The data given in the graph are described as follows: My agency's current model-based design review process results in consistent contract documents and models: 5, Strongly agree; Having review procedures that result in more consistent contract documents and models is important: 5, Strongly agree; The methodology I tested can help my agency deliver more consistent contract documents and models: 4.5, close to the right side of the scale.

Page 130
Suggested Citation:"APPENDIX F: TASK 8 METHODOLOGY REVIEW FEEDBACK." National Academies of Sciences, Engineering, and Medicine. 2025. Quality Management for Digital Model–Based Project Development and Delivery. Washington, DC: The National Academies Press. doi: 10.17226/29172.
×
  1. To what extent do you agree with these statements about REPEATABILITY of reviews?

The right side of the scale reads, Strongly agree. The left side of the scale reads, Strongly disagree. The data given in the graph are described as follows: My agency's current model-based design review process is repeatable from one project to the next: 3.5, closer to the right side than the left; Having review procedures implemented in a repeatable way is important: 5, Strongly agree; The methodology I tested can help my agency implement repeatable review procedures: 4, closer to the right side than the left.

  1. To what extent do you agree with these statements about the REPRODUCIBILITY of reviews?

The right side of the scale reads, Strongly agree. The left side of the scale reads, Strongly disagree. The data given in the graph are described as follows: My agency's current model-based design review process is reproducible from one person to the next: 3.5, closer to the right side than the left; Having review procedures implemented in a reproducible way is important: 5, Strongly agree; The methodology I tested can help my agency implement reproducible review procedures: 4, closer to the right side than the left.

  1. To what extent do you agree with these statements about the TRACEABILITY of reviews?

The right side of the scale reads, Strongly agree. The left side of the scale reads, Strongly disagree. The data given in the graph are described as follows: My agency's current model-based design review process results in documentation where decision-making is traceable: 3.5, closer to the right side than the left; Having review procedures that result in documentation that traces decision-making is important: 5, Strongly agree; The methodology I tested can help my agency implement review procedures that are documented in a way that traces the decision-making: 4, closer to the right side than the left.

Page 131
Suggested Citation:"APPENDIX F: TASK 8 METHODOLOGY REVIEW FEEDBACK." National Academies of Sciences, Engineering, and Medicine. 2025. Quality Management for Digital Model–Based Project Development and Delivery. Washington, DC: The National Academies Press. doi: 10.17226/29172.
×
  1. What other attributes of review procedures do you believe are important?
    • Version control – the ability to track what has been reviewed and what still needs to be reviewed; the ability to compare one milestone to the next; the ability to verify the final version.
    • Methods for review and how the review is documented. Each DOT will do this differently, but guidance is preferred.
    • Simplicity-Structured-Documentation and Record Keeping of Model QA/QC – QA/QC Procedures Fit within ISO 9001 Framework.
  2. To what extent do you agree with these statements about the 3D Model Integrity Review?

The right side of the scale reads, Strongly agree. The left side of the scale reads, Strongly disagree. The data given in the graph are described as follows: The review definition is comprehensive: 5, Strongly agree; My agency has a standard or manual that defines performance requirements for the elements that define the review: 4.5, close to the right side of the scale.

  1. Please provide any constructive feedback regarding the 3D Model Integrity review definition.
    • In my experience, the 3D Model Integrity Review would take place with the 3D Modeling Standards Review (LOD and LOIN) or within the Discipline Design Review. Consider Combing for simplicity.
Page 132
Suggested Citation:"APPENDIX F: TASK 8 METHODOLOGY REVIEW FEEDBACK." National Academies of Sciences, Engineering, and Medicine. 2025. Quality Management for Digital Model–Based Project Development and Delivery. Washington, DC: The National Academies Press. doi: 10.17226/29172.
×
  1. To what extent do you agree with these statements about 3D Model Standards Review?

The right side of the scale reads, Strongly agree. The left side of the scale reads, Strongly disagree. The data given in the graph are described as follows: The review definition is comprehensive: 4.5, close to the right side of the scale; My agency has a standard or manual that defines performance requirements for the elements that define the review: 5, Strongly agree.

  1. Please provide any constructive feedback regarding the 3D Model Standards review definition.
    • Metadata definition is also used to define POIN attributes in Utah. Consider using ‘File Metadata.’
  2. To what extent do you agree with these statements about the Clash Detection and Spatial Coordination Review?

The right side of the scale reads, Strongly agree. The left side of the scale reads, Strongly disagree. The data given in the graph are described as follows: The review definition is comprehensive: 5, Strongly agree; My agency has a standard or manual that defines performance requirements for the elements that define the review: 1, Strongly disagree.

  1. Please provide any additional feedback regarding the Clash Detection and Spatial Coordination review definition.
    • Utah does have standards for Sight Distance. Both of these review cases are done in the Discipline Design Review.
Page 133
Suggested Citation:"APPENDIX F: TASK 8 METHODOLOGY REVIEW FEEDBACK." National Academies of Sciences, Engineering, and Medicine. 2025. Quality Management for Digital Model–Based Project Development and Delivery. Washington, DC: The National Academies Press. doi: 10.17226/29172.
×
  1. To what extent do you agree with these statements about the Discipline Design Review?

The right side of the scale reads, Strongly agree. The left side of the scale reads, Strongly disagree. The data given in the graph are described as follows: The review definition is comprehensive: 5, Strongly agree; My agency has a standard or manual that defines performance requirements for the elements that define the review: 4.5, close to the right side of the scale.

  1. To what extent do you agree with these statements about the 7-step process?

The right side of the scale reads, Strongly agree. The left side of the scale reads, Strongly disagree. The data given in the graph are described as follows: The overarching 7-step process is comprehensive: 4.5, close to the right side of the scale; My agency has a standard, manual, or policy that describes review procedure requirements: 3.7, closer to the right side than the left; The overarching 7-step process is relatable and useful for my agency: 5, Strongly agree.

  1. To what extent do you agree with these statements about the review scope and documents lists?

The right side of the scale reads, Strongly agree. The left side of the scale reads, Strongly disagree. The data given in the graph are described as follows: The review scopes were comprehensive and relatable: 3, about midway between the left and right sides of the scale; My agency has a standard or manual that fits or describes the reference and review documents listed in the tables: 2.5, closer to the left side than the right; The list of required documents is helpful for my agency: 4, closer to the right side than the left.

Page 134
Suggested Citation:"APPENDIX F: TASK 8 METHODOLOGY REVIEW FEEDBACK." National Academies of Sciences, Engineering, and Medicine. 2025. Quality Management for Digital Model–Based Project Development and Delivery. Washington, DC: The National Academies Press. doi: 10.17226/29172.
×
  1. To what extent do you agree with these statements about the review scope and documents lists?

The right side of the scale reads, Strongly agree. The left side of the scale reads, Strongly disagree. The data given in the graph for each statement is 4, which appears closer to the right side of the scale than the left. The statements in the graph are: The review procedures were comprehensive; The review procedures were understandable and relatable; The core competencies were understandable and relatable; The procedures and core competencies were helpful for my agency.

  1. Which of the following job aids did you use?

The graph shows a horizontal axis with three labeled bars. The data given in the graph are as follows: Glossary of 3D modeling and quality management terms: 2; The model element table: 1; The quality control checklists: 2.

  1. To what extent do you agree with these statements about the supplied job aids?

The right side of the scale reads, Strongly agree. The left side of the scale reads, Strongly disagree. The data given in the graph are described as follows: The glossary of terms was comprehensive: 4.5, close to the right side of the scale; The glossary of terms was useful and terms were relatable: 4, closer to the right side than the left; The Model Element Table was useful: 3.5, closer to the right side than the left; The Model Element Table was confusing: 1.5, close to the left side of the scale; The checklists were useful and relatable: 4.5, close to the right side of the scale.

Page 135
Suggested Citation:"APPENDIX F: TASK 8 METHODOLOGY REVIEW FEEDBACK." National Academies of Sciences, Engineering, and Medicine. 2025. Quality Management for Digital Model–Based Project Development and Delivery. Washington, DC: The National Academies Press. doi: 10.17226/29172.
×
  1. Did you use the Model Element Table?

The graph shows a horizontal axis with three categories and one labeled bar. The data given in the graph are as follows: Yes: 0; I wanted to but didn't have time: 0; No: 3.

  1. Which checklist did you use?

The graph shows a horizontal axis with four categories and one labeled bar. The data given in the graph are as follows: Del DOT 3D model integrity: 0; N C DOT survey: 0; N C H R P Project 10 113 3D model integrity: 0; My own agency's checklist or checklists: 2.

Page 127
Suggested Citation:"APPENDIX F: TASK 8 METHODOLOGY REVIEW FEEDBACK." National Academies of Sciences, Engineering, and Medicine. 2025. Quality Management for Digital Model–Based Project Development and Delivery. Washington, DC: The National Academies Press. doi: 10.17226/29172.
×
Page 127
Page 128
Suggested Citation:"APPENDIX F: TASK 8 METHODOLOGY REVIEW FEEDBACK." National Academies of Sciences, Engineering, and Medicine. 2025. Quality Management for Digital Model–Based Project Development and Delivery. Washington, DC: The National Academies Press. doi: 10.17226/29172.
×
Page 128
Page 129
Suggested Citation:"APPENDIX F: TASK 8 METHODOLOGY REVIEW FEEDBACK." National Academies of Sciences, Engineering, and Medicine. 2025. Quality Management for Digital Model–Based Project Development and Delivery. Washington, DC: The National Academies Press. doi: 10.17226/29172.
×
Page 129
Page 130
Suggested Citation:"APPENDIX F: TASK 8 METHODOLOGY REVIEW FEEDBACK." National Academies of Sciences, Engineering, and Medicine. 2025. Quality Management for Digital Model–Based Project Development and Delivery. Washington, DC: The National Academies Press. doi: 10.17226/29172.
×
Page 130
Page 131
Suggested Citation:"APPENDIX F: TASK 8 METHODOLOGY REVIEW FEEDBACK." National Academies of Sciences, Engineering, and Medicine. 2025. Quality Management for Digital Model–Based Project Development and Delivery. Washington, DC: The National Academies Press. doi: 10.17226/29172.
×
Page 131
Page 132
Suggested Citation:"APPENDIX F: TASK 8 METHODOLOGY REVIEW FEEDBACK." National Academies of Sciences, Engineering, and Medicine. 2025. Quality Management for Digital Model–Based Project Development and Delivery. Washington, DC: The National Academies Press. doi: 10.17226/29172.
×
Page 132
Page 133
Suggested Citation:"APPENDIX F: TASK 8 METHODOLOGY REVIEW FEEDBACK." National Academies of Sciences, Engineering, and Medicine. 2025. Quality Management for Digital Model–Based Project Development and Delivery. Washington, DC: The National Academies Press. doi: 10.17226/29172.
×
Page 133
Page 134
Suggested Citation:"APPENDIX F: TASK 8 METHODOLOGY REVIEW FEEDBACK." National Academies of Sciences, Engineering, and Medicine. 2025. Quality Management for Digital Model–Based Project Development and Delivery. Washington, DC: The National Academies Press. doi: 10.17226/29172.
×
Page 134
Page 135
Suggested Citation:"APPENDIX F: TASK 8 METHODOLOGY REVIEW FEEDBACK." National Academies of Sciences, Engineering, and Medicine. 2025. Quality Management for Digital Model–Based Project Development and Delivery. Washington, DC: The National Academies Press. doi: 10.17226/29172.
×
Page 135
Next: APPENDIX G: IHEEP 2023 WORKSHOP SUMMARY »
Quality Management for Digital Model–Based Project Development and Delivery Get This Book
×
 Quality Management for Digital Model–Based Project Development and Delivery
MyNAP members save 10% online.
Login or Register to save!
Download Free PDF

NCHRP Web-Only Document 428: Quality Management for Digital Model–Based Project Development and Delivery, from TRB’s National Cooperative Highway Research Program, addresses two key challenges for state departments of transportation and other highway agencies: the use of 3D models as a new way to review construction designs and the review of the 3D models themselves.

The document is supplemental to NCHRP Research Report 1153: Digital Model–Based Project Development and Delivery: A Guide for Quality Management.

READ FREE ONLINE

  1. ×

    Welcome to OpenBook!

    You're looking at OpenBook, NAP.edu's online reading room since 1999. Based on feedback from you, our users, we've made some improvements that make it easier than ever to read thousands of publications on our website.

    Do you want to take a quick tour of the OpenBook's features?

    No Thanks Take a Tour »
  2. ×

    Show this book's table of contents, where you can jump to any chapter by name.

    « Back Next »
  3. ×

    ...or use these buttons to go back to the previous chapter or skip to the next one.

    « Back Next »
  4. ×

    Jump up to the previous page or down to the next one. Also, you can type in a page number and press Enter to go directly to that page in the book.

    « Back Next »
  5. ×

    Switch between the Original Pages, where you can read the report as it appeared in print, and Text Pages for the web version, where you can highlight and search the text.

    « Back Next »
  6. ×

    To search the entire text of this book, type in your search term here and press Enter.

    « Back Next »
  7. ×

    Share a link to this book page on your preferred social network or via email.

    « Back Next »
  8. ×

    View our suggested citation for this chapter.

    « Back Next »
  9. ×

    Ready to take your reading offline? Click here to buy this book in print or download it as a free PDF, if available.

    « Back Next »
Stay Connected!