Evaluate Previous Iterations Using SWOT Analysis (3 of 9)
We’ve all heard the term iterate but does it really happen? I’d love to say yes, but with constraints on resources and educators, it can be challenging to iterate throughout and at the conclusion of every course. It can sometimes seem fruitless especially if your previous version was face to face; and you are transitioning online; however, it is crucial that you review what worked, what didn’t and where there are opportunities to improve.
Evaluations can be resource and time intensive depending upon the model that you use. Let’s be realistic, you may not have the data, the time, or the resources to complete a thorough evaluation. One model that can be quick and easy to use and gain insights about what worked and what didn’t is a SWOT analysis.
What is a SWOT analysis?
SWOT analysis is an evaluation method that is widely used in companies to identify improvements that can be made to systems, processes and/or products. It provides quick insights into what 'quick wins you can have by making changes to the next iteration and place yourself as a leader in your field. MindTools provides great detail if you want to delve further but to summarise the questions you can ask in relation to an evaluation is:
Strengths: Strengths are things that your course does well; and will distinguish you from your competitors. Consider the advantages your organisation/institution has over others. What are the motivations for educators, and for learners? You can ask yourself:
What went well?
What would the educator/learner perceive to be a strength of the course?
Weaknesses: This can be hard to be objective but it is important to be honest so you can focus on what your could improve and areas that you can avoid next time. Consider how learners are engaging with the content; how they are interacting within the course; and whether they are achieving the outcomes and think about why. Ask yourself:
What didn’t go so well?
What would the educator/learner perceive to be a weakness of the course?
Opportunities: This is used to identify developments in the market, or different technology, and how you can use these to create opportunities within your course. These can be small wins such as connecting with industry for learners or implementing new technology that is more relevant in the particular industry. You can ask yourself:
Are there market trends in your content area that you can take advantage off?
How can you leverage the strengths as opportunities?
Threats: Consider anything that may negatively impact your course from negative learner experiences, to lack of educator knowledge when dealing with technology. It is important to record these as you can ensure you are ahead of the curve and translate these into opportunities. You can ask yourself:
What, if anything could be detrimental your course?
How can your weaknesses become a threat?
As challenging as it may be, it is crucial to be objective during this process so you are not influenced by your thoughts and feelings. It can be challenging to do this, especially if you have been facilitating a course for some time or you created it to begin with. You can ensure you are as objective as possible by doing this with your critical friend! In the video below I am going to share with you how you can complete a SWOT analysis in a learner experience context.
What do you do with the SWOT analysis?
Now that you have completed your SWOT analysis, it is time to highlight what you are going to focus on in your design. Consider quick wins initially and what will have the biggest impact for the learner experience. It is important to have this highlighted so when you are creating your learner experience map, you are making necessary adjustments.
Alternative Evaluation Models
A SWOT analysis is one evaluation model that can be done effectively at the beginning of a design session to leverage knowledge from the subject matter experts, and any learning analytics you may have access to. There are alternate models that you can use, and I have outlined a few resources for you to explore further below:
Kirkpatrick’s four-level training evaluation model: If you are delivering training, this is a good evaluation model to determine how effective you have been. This model helps you to analyse the impact of your training, what worked well and how it can be used to improved future training offerings.
Evaluation cookbook: a great resource for you to review why you need to evaluate and many different evaluation models that you may find is fit for your context.
Summary
Online training and courses can sometimes be part of a ‘set and forget’ mentality however evaluation is critical of any course or training to ensure you are focussed on the best learner experience. To summarise:
It may not be perfect the first time, but remember to iterate;
There is value in evaluation;
Use the SWOT (Strengths, Weaknesses, Opportunities, and Threats) analysis to inform your design;
Highlight what you are going to focus on in your design - where are the quick wins and the most impactful?; and
Be objective and if possible, complete the evaluation with a critical friend.
Next steps
This is post 3 of 9 and if you haven’t already, I recommend joining an online whiteboard where you can document everything we have been progressing through. I am using Miro, but you can use alternatives such as Mural, Stormboard, or Excel if you prefer. Now, complete a SWOT analysis for your context.
