Evaluation & Measurement
Take a Deeper Look into the Impact of Your elearning Programs
Evaluating and truly understanding the effectiveness of your elearning ecosystem can be difficult and is often misleading. While most organizations focus on the number of courses completed, or the learning hours provided to staff, determining the overall effectiveness of elearning is far more complicated. Perhaps this is why many organizations skip the process of obtaining objective measures of elearning all together.
Our Approach to elearning Evaluation and Measurement
Evaluation in learning is usually classified into two types: formative and summative. A summative evaluation of a training program assesses the overall effectiveness of the program at its conclusion, determining whether it achieved its intended goals, while a formative evaluation occurs during the development and implementation of the training, providing ongoing feedback to make improvements before the program is finalized.
Using the Allen Interactions Deeper Learning™ approach, our experts design learning solutions that measure both effective and affective metrics.
Following the guidance of the Serious eLearning Manifesto (https://elearningmanifesto.org/), our measurement and evaluation process takes steps to:
Measure Outcomes
Measure whether the learning has led to benefits for the individual and/or the organization. This includes affective measurements used to adapt the learner’s journey and to determine confidence in post-training performance.
Measure Actual Performance Results
At an appropriate time after the learning (for example, two to six weeks later), measure whether the learner has applied the learning, the level of success in doing so, the success factors and obstacles encountered, and the level of supervisor/organizational support.
Measure Learning Comprehension and Decision-Making During Learning
At a minimum, during the learning, we will measure both learner comprehension and decision-making ability. Ideally, we would also measure these at least a week or two after the learning.
Measure Meaningful Learner Perceptions
When we measure learners’ perceptions, we will measure their perceptions of the following: their ability to apply what they’ve learned, their level of motivation, and the support they will or have received in implementing the learning.
By evaluating these specific factors, we can help you gain a more detailed and useful perspective of the effectiveness of your learning programs than is revealed by traditional quizzes and posttests which measure only completion and short-term knowledge retention.
Download Our 4 Pillars Playbook
Creative Interactive eLearning Instructional Designs ebook.
Instructional interactions require four components: Context, Challenge, Activity, and Feedback (CCAF). There is surprising complexity in how designers master this model.
Download this eBook to explore this complexity and establish some straightforward insights into how to best integrate CCAF thinking into your own digital learning design process.
Featured Case Study
Expedia Case Study
Impactful Customer Service Training
Expedia is an American online travel shopping company for consumer and small business travel.
Expedia needed to improve customer service skills for its call center agents that could provide them measurable performance in areas of customer service and destination knowledge. The need required an e-learning design and course interface with engaging scenarios and situations for learning about specific travel destinations that could be replicated.
After trusting Allen Interactions with their training needs, the results are staggering with large increases in destination sales knowledge and customer service:
63% increase in overall destination knowledge
56% increase in knowledge in hotels/attractions
42% increase of destination layout knowledge
42% increase in ability to answer customer questions