Below is the uncorrected machine-read text of this chapter, intended to provide our own search engines and external engines with highly rich, chapter-representative searchable text of each book. Because it is UNCORRECTED material, please consider the following text as a useful but insufficient proxy for the authoritative book pages.
106 A P P E N D I X H Level 3 Training Evaluation Tool The Kirkpatrick/Philips training evaluation model was developed by Donald L. Kirkpatrick and Jack Phillips. The model consists of five levels of training evaluation: Level 1: The reaction of participants Level 2: The level of learning achieved Level 3: Changes in learner behavior Level 4: Business results derived from training Level 5: Return on investment (ROI) that the training delivers This tool is intended to assist transit agencies in conducting Level 3 training evaluations. The assessments on the following pages are targeted at employees who have recently completed a training course, to gather information regarding the transfer of knowledge and skills gained in training to the work environment. Participants must evaluate how their behaviors have changed as a result of the training. This includes evaluating the extent to which they are or are not able to apply knowledge and skills from the training course on the job. While Level 1 and 2 evaluations should be completed as soon as possible before and after participants complete a training course, a Level 3 evaluation should take place once immediately before the training and again 2-3 months after the training. This provides participants with time to transfer new information from the training to their jobs and change their behaviors accordingly. Supervisors and managers should also be encouraged to observe their employeesâ behaviors during this time period and complete the evaluation post-training. Instructions: [Insert timeframe in months (e.g., three months ago)], you completed the [insert course name]. This survey is intended to assess the effectiveness of the training in order to improve the course. Your participation is critical, so please complete the survey between now and [insert survey response deadline date]. The survey is divided into three parts: Part 1 asks you to provide a self-assessment for key behaviors covered in the [insert course name]. We encourage you to provide a constructive self-assessment of your behaviors to help us understand how to target future learning initiatives.
Level 3 Training Evaluation Tool 107 future training initiatives. The survey will take you approximately [insert expected duration in minutes] to complete. If you have any questions regarding the survey, please contact [insert contact name, email address, phone number]. Thank you for your valuable input! Part 1: Behavioral Response Scale Questions Instructions: For this section, you will be presented with a selection of behavioral statements. For each statement, please indicate the following: FrequencyâHow often you demonstrate the behavior. Response Choice Response Definition Often I demonstrate the behavior most of the time to accomplish work tasks. Sometimes I demonstrate the behavior when it is practical or convenient for getting my work done, but not always. Seldom I rarely demonstrate the behavior in the workplace. ProficiencyâHow well you currently perform the behavior. Response Choice Response Definition Proficient I am skilled in this area and can execute the behavior consistently. Somewhat Proficient I am fairly skilled in this area but may need additional training (classroom, job aids, self-instruction, on-the-job) to feel comfortable. Limited Proficiency I have limited skill in this area; significant training (classroom, job aids, self-instruction, on-the-job) would be needed before I could perform it consistently. Part 2 asks about your overall experience in the training and your ability to transfer learning from the course to your day-to-day work. Part 3 asks you to answer some questions about yourself so that we may be able to better target improvements to the course based on various participantsâ needs. Your openness in answering each question here is essential to the value of this evaluation. [Transit agency/training provider] âs goal in conducting this evaluation is to better understand how the learning objectives of the training are reflected in your workplace behaviors. [Transit agency/training provider] is not collecting or using this information for consideration in any administrative decisions. Your responses will not affect individual evaluations in any way. [Transit agency/training provider] will compile aggregate (group-level) data for all training class participants. Your individual responses are kept confidential so that no personal identifiers (e.g., name) are linked to your responses. We encourage you to provide a constructive self- assessment of your behaviors to help [transit agency/training provider] understand how to target
108 Transit Technical Training, Volume 2: Guide to Overcoming Barriers to Implementing Best and Innovative Training Please use the drop-down menus to record your response for each behavioral survey item. Behavioral Survey Item Frequency Proficiency Change 1.1 Behavioral Survey Item 1 Choose an item. Choose an item. Choose an item. 1.2 Behavioral Survey Item 2 Choose an item. Choose an item. Choose an item. 1.3 Behavioral Survey Item 3 Choose an item. Choose an item. Choose an item. 1.4 Behavioral Survey Item 4 Choose an item. Choose an item. Choose an item. 1.5 Behavioral Survey Item 5 Choose an item. Choose an item. Choose an item. 1.6 Behavioral Survey Item 6 Choose an item. Choose an item. Choose an item. 1.7 Behavioral Survey Item 7 Choose an item. Choose an item. Choose an item. 1.8 Behavioral Survey Item 8 Choose an item. Choose an item. Choose an item. 1.9 Behavioral Survey Item 9 Choose an item. Choose an item. Choose an item. 1.10 Behavioral Survey Item 10 Choose an item. Choose an item. Choose an item. Part 2: Overall Training Experience and Transfer Instructions: For each item below please provide detailed responses, including examples when applicable. 2.1 Please explain how and why you were able to apply the knowledge you gained in this training to the job. ChangeâWhether you have shown any changes in the behavior over the past few months. Response Choice Response Definition Positive Change I have seen positive adjustments in my behavior since I participated in this training. No Change I have seen no adjustments in my behavior since completing this training. Negative Change I have seen negative adjustments in my behavior since prior to this training.
Level 3 Training Evaluation Tool 109 Part 3: Demographic Information Instructions: Please answer each of the questions below. We are sensitive to preserving the confidentiality of your responses. We will compile only aggregate (group-level) results for all training participants. Responses will only be divided by demographic information if there are sufficient sample sizes to preserve anonymity. 3.1 What is your current department at [transit agency]? Department 1 Department 2 Department 3 3.2 What is your current position in this department? Position 1 Position 2 Position 3 3.3 How many years of experience do you have in your current position? Less than 1 year 1-2 years 3-5 years More than 5 years 2.2 Please explain why you were not able to apply the knowledge you gained in this training to the job.
