Mid-Year Check Up on Measurement and Reporting

Since we are well into the month of July, I thought it the perfect time to reflect on what we have accomplished so far this year in the world of measurement and reporting.

If you are running learning like a business, that means you set specific, measurable plans or targets for your key measures. How are they doing compared to the plan? Are they where they need to be if you are going to make the plan by the end of the year? If you have started to provide forecasts for how the year will end, you can just compare the plan to the forecast. If you are not yet at the stage of making forecasts, just ask yourself if you are on track to make the plan by the end of the year. Even if it appears you will not make the plan on your current trajectory, the good news is that you still have six months to do something about it. What steps can you take now to get back on plan?

Even if you did not set plans for measures, this is a perfect time to see what you can learn from the first six months. Here are some measures to check:

  • Completion rate: Are you getting the completion rates for formal learning programs that you would expect? Are there significant differences between programs or audiences?
  • Reach: Are you reaching as many employees with learning as you hoped? What percentage of employees have been enrolled in formal learning? How many have engaged in some informal learning?
  • Cost: Do you know what your costs are for the first six months? Are you on budget? Where are the surprises and what can you learn from them?
  • Total Participants: While reach measures whether an employee has taken at least one course or touched at least one informal learning asset, total participants allow for employees to take more than one course or interact with more than one learning asset. So, your reach may be meeting expectations while total participation is not. Are you satisfied with your total participation?
  • Usage: Closely aligned to participation is your usage of online and virtual courses as well as informal learning like communities of practice, portal content, and performance support tools. Are you getting the usage you want?
  • Level 1: Is your participant’s reaction to the learning at an acceptable level? Did it drop when you switched from ILT to VILT? How do your L1 scores compare for VILT and online? Are you measuring L1 for your informal learning assets? How do they compare to formal learning? Where are your opportunities for improvement?
  • Level 2: Are you satisfied with the test scores for your VILT and online courses? Are the VILT scores lower than you were getting for ILT? If so, does the content or instruction need to change?
  • Level 3: Are your application rates where they should be or do have too much scrap learning? Did L3 decline during COVID? If it did, what could you change to improve?
  • Employee Engagement: If you are measuring employee engagement quarterly, has employee engagement with their learning changed with COVID? Are employees happy with the learning opportunities available to them? If it dropped initially after employees began to work from home, has it come back to an acceptable level?

These are just some of the questions that you should consider answering with your data. Remember that a key aspect of running learning like a business is learning from the data. Mid-year is a perfect time to see what you can learn from the first half of the year and then use that knowledge to make improvements in the second half for a strong finish.

Speak Your Mind