A few years ago, I was a judge for a competition on scenario-based learning. While there were a few terrific submissions, I thought many of the courses missed the whole point of scenario-based learning. They started out fine: they provided some sort of realistic context and asked learners to make a decision. Then, instead of showing them the consequences of their decision, they just provided feedback as if it was any other multiple choice assessment. “Correct, that is the best decision.” Blah. Boring. And ineffective.
In her book Scenario-based e-Learning: Evidence-Based Guidelines for Online Workforce Learning, Ruth Clark labels the two types of feedback “intrinsic” and “instructional.” Instructional feedback is what we see all the time in e-learning; it’s feedback that tells you what was right or wrong and possibly guides or coaches you about how to improve.
With intrinsic feedback, the learning environment responds to decisions and action choices in ways that mirror the real world. For example, if a learner responds rudely to a customer, he will see and hear an unhappy customer response. Intrinsic feedback gives the learner an opportunity to try, fail, and experience the results of errors in a safe environment.
Intrinsic feedback is one of the features of scenario-based learning that sets it apart from traditional e-learning. When you show learners the consequences of their actions, they can immediately see why it matters. The principles or process that you’re teaching isn’t just abstract content anymore; it’s something with real world implications and it matters if they get it wrong. It’s more engaging to receive intrinsic feedback. Learners are also more likely to remember the content because they’ve already seen what could happen if they don’t make the right choices.
Intrinsic feedback can take a number of forms. Customer reactions (verbal and nonverbal), patient health outcomes improving, sales figures dropping, a machine starting to work again, and other environmental responses can be intrinsic feedback. The example below contains three pieces of intrinsic feedback, all on the left side: a facial expression, a conversation response, and a motivation meter at the bottom.
In this example, learners are trying to convince someone to make healthier eating choices using motivational interviewing. Motivation level is an “invisible” factor, so I made it visible with a motivation indicator in the lower left corner. As learners make better choices and the patient feels more motivated to change, the motivation meter shows their progress.
Scenarios can also use instructional feedback. In the above example, a coach at the top provides instructional feedback and guidance on learners’ choices. Clark recommends using both intrinsic and instructional feedback in most situations.
One issue with instructional feedback is that it can break the realism of a scenario. Using a coach can help alleviate that problem, as can having learners ask for advice from people inside a scenario (a manager, an HR rep, another worker, etc.). Using a conversational tone for the instructional feedback also helps keep it within the scenario. Instructional feedback in a scenario often doesn’t need to explicitly say that a choice was correct or incorrect; that’s clear enough from the intrinsic feedback. Focus your instructional feedback on explaining why a choice was effective or how it could have been better.
Feedback can also be delayed rather than happening immediately. Clark recommends more immediate feedback for novices but delayed feedback for experts or more advanced learners. Depending on the audience, for some branching scenarios I do immediate intrinsic feedback for each choice learners make. When learners make bad choices that cause them fail and they need to restart the scenario, they receive instructional feedback with guidance on how to improve on their next attempt. They might be able to make two or three bad choices in a row before they hit a dead end in the scenario, so the instructional feedback is delayed. It keeps the momentum of the scenario moving forward but still provides support to learners to help them improve.
If you’re building scenario-based learning, don’t leave out the intrinsic feedback! Your learners will thank you.
If you’re looking for some reading to improve your skills or get started in the field of instructional design, check out these books.
General Instructional Design and E-Learning
Design For How People Learn by Julie Dirksen is one of my favorite books in the field. I’ve recommended it many times. It’s easy to read and understand. It makes research about learning accessible in ways you can apply immediately. The illustrations are charming and reinforce the concepts well. Read my review for more details.
The Accidental Instructional Designer by Cammy Bean is especially good for career changers and those who landed in instructional design from other fields. It provides a model for the range of skills that fall under the umbrella of “instructional design.” It includes practical tips on topics such as working with SMEs and avoiding “clicky clicky bling bling” or flashy interactivity and multimedia for the sake of being flashy. The design models in chapter 4 are probably familiar to many with experience in the field but very helpful to beginners who want to do more than just the same type of course and interaction for every situation.
Designing Successful e-Learning by Michael Allen tells you to “Forget What You Know About Instructional Design and Do Something Interesting.” All of Allen’s books are focused on helping people design e-learning that is interactive, engaging, and useful.
e-Learning and the Science of Instruction by Ruth Clark and Richard Mayer is one of the first books on e-learning I bought, and I still refer to it when I need evidence to justify decisions to clients. If you’ve ever wondered if formal or conversational style is better for learning (conversational) or if your on-screen text should replicate what’s on the screen (no, it shouldn’t), this book explains it with the research to back it up. It’s not perfect; the authors do sometimes disregard research that contradicts their own findings, and they sometimes make their principles seem more absolute than they probably are in real life. However, it’s still a solid reference.
First Principles of Instruction: Identifying and Designing Effective, Efficient and Engaging Instructionis David Merrill’s effort to distill the common principles from multiple instructional design theories. A shorter, earlier explanation of these principles is available as a free PDF.
Games and Scenario-Based Learning
The Gamification of Learning and Instruction by Karl Kapp explains how to do more with gamification than just badges and points. Karl summarizes research and game theory and explains how substantive elements of games like narrative can be used to improve learning design. I wrote more about this gamification research previously.
Scenario-based e-Learning by Ruth Clark is similar to eLearning and the Science of Instruction in that it summarizes research findings. This book is specifically focused on developing scenario-based e-learning, including everything from simple branching scenarios to complex simulations.
Building Online Learning Communities by Rena Palloff and Keith Pratt is aimed more at online instructors than instructional designers, but it’s a wonderful resource for IDs working in higher education or supporting online and blended learning communities.
Digital Habitats: Stewarding Technology for Communities by Etienne Wenger, Nancy White, and John Smith is about how technology can enable communities of practice.
Learning Everywhere by Chad Udell is a fantastic resource on mobile learning, providing everything from a big picture view of broad categories of mobile learning to specific technical considerations and pitfalls. You can read my review of the book for more details.
Show Your Work by Jane Bozarth is full of visuals and explains how to “show your work” by sharing what you’re doing and learning using social tools. The book explains the benefits of creating a culture where people share their processes and discoveries.
E-Learning Uncovered: Adobe Captivate 8 by Diane Elkins, Desiree Pinder, and Tim Slade sat on my desk for multiple weeks because I used it so often that it wasn’t worth bothering to put it back on the shelf. This book was an immense help to me in learning Captivate 8. I’m sure their other books on Storyline 2, Lectora, etc. are equally valuable.
More Reading Lists
If that’s not enough, these reading lists will give you additional ideas.
- 8 Books To Read Before Your Next eLearning Project (Anna Sabramowicz)
- Instructional Design Books I’ve read for my IS degree (Gina Minks)
- Essential Reading for Instructional Design? (Cammy Bean)
- How to get an Instructional Design education without paying tuition (Tim Curry)
- An immediately accessible instructional design education (Tim Curry)
Did I miss one of your favorite books? Leave a comment with your suggestions.