How to measure training effectiveness: the four levels of post-training evaluation

Training effectiveness is the evaluation that shows how far a training session changed the participant’s knowledge, the way they work and, in the end, the result of the work. An attendance list proves that a training took place; measuring effectiveness asks whether it actually helped. The two are not the same, and in many companies the second question is never asked.

In this article we explain step by step how to set up post-training evaluation on four levels, which questions to ask at each level and how to keep the results together with the training record.

The difference between attendance and effectiveness

An audit usually asks: Was the mandatory training delivered, who attended, is the certificate still valid? These are attendance and compliance questions. Management wants to know something else: After the forklift training, are there fewer damaged pallets in the warehouse? After the customer communication training, has the tone of complaints changed? That is an impact question. A healthy training process records both, without mixing them up.

The four levels of training effectiveness

The approach widely used in human resources splits evaluation into four layers. Each layer is harder to measure than the previous one, but gives more meaningful information.

1. Reaction: Did the participant find the training useful, clear and relevant to their job? Measured with a short survey right at the end of the session.
2. Learning: Did the participant gain new knowledge or a new skill? Shown by a short test or a practical demonstration before and after the training.
3. Behaviour: Is what was learned applied on the job? Seen some time after the training through manager observation, a checklist or an on-site inspection.
4. Results: Did the business indicator change? Compared with data the company already tracks, such as errors, returns, near-miss reports or customer complaints.

Setting up an evaluation process step by step

1. Write down the goal before the training

A goal that cannot be measured cannot be evaluated. Instead of “employees should learn about workplace safety”, write an observable sentence such as “the warehouse team fills in the pre-loading checklist completely”. This sentence also defines in advance what you will look at on the behaviour level.

2. Record the starting point

A comparison needs a “before”. Run a short pre-test before the training or note the current state of the relevant business indicator. If the earlier state is unknown, it stays debatable whether a change noticed later came from the training or from another cause.

3. Run a short survey and a post-test at the end of the training

Keep the reaction survey short and send it right after the training. In the post-test, use questions similar to those in the pre-test so that the difference can be read.

• To what extent do you think you can use what was covered in your work?
• How relevant to your job were the explanations and examples?
• Is there anything you will do differently in your work after this training? Please describe.
• Which topic was missing or needs more practice?

4. Look at behaviour after some time

A few weeks after the training, ask the unit manager to fill in a short observation form, or carry out an on-site check. Keep the question simple: Is the behaviour you wrote in the goal visible, and if not, what is in the way? Often the obstacle is not the training but missing equipment or time pressure.

5. Compare the result with the business indicator and close the record

Look again at the indicator you noted at the start. Write the change into the training record, together with attendance and test results. With this record you decide in the next annual plan whether to repeat the training and whether to change its content.

Common mistakes

• Looking only at the reaction survey and calling the training a success; a well-liked training may not have changed behaviour.
• Sending the survey days after the training; participation drops and answers become vague.
• Keeping survey results, attendance records and certificate information in separate files; the same table is rebuilt for every audit and every plan.
• Not addressing the worry that critical comments will be linked to names; consider an anonymous option for open feedback.

Keeping the training record and the evaluation in one place

An evaluation process can start with paper forms and scattered spreadsheets, but as the number of employees and trainings grows, matching the records gets harder. The Training Management module of YazSis KurumsalPortal plans the training, assigns it to participants and sends notifications; it records attendance through a roll call, keeps certificate information in the employee’s training record, warns about certificates that are about to expire and reports compliance rates. For reaction and feedback questions after a training, the Survey Management module can be used to prepare targeted or anonymous surveys; participation and the distribution of answers are tracked in the same portal.

This way HR, occupational safety and unit managers work from the same record. If you would like to set up training tracking and evaluation together, you can review the modules on the KurumsalPortal page and talk to us about your needs.