What the research says

Gamification: What Works, According to 40 Experiments

Points, badges, stories and leaderboards: a meta-analysis of 40 experiments measured what game elements do for learning, motivation and behaviour, and which combinations work best.

By the Giga Quizzes team4 min read
The bright, crowded playfield of a pinball machine
Photo: Heather McKean, Unsplash, Unsplash License, cropped.
In this post
  1. 1Gamification is not the same as a learning game
  2. 2What went into the analysis
  3. 3The results
  4. 4Competition plus collaboration did best
  5. 5A story helps, sometimes
  6. 6Caveats from the authors
  7. 7Applying it to a class quiz

Gamification has been called everything from the future of education to “the latest buzzword and the next fad”. Michael Sailer and Lisa Homner, education researchers at LMU Munich, set out to settle the argument with numbers. Their 2020 meta-analysis pulled together every controlled experiment they could find on game elements in learning, and asked two questions: does gamification work, and if so, which kind? The first answer is a cautious yes. The second is more interesting.

Gamification is not the same as a learning game

The paper starts with a distinction worth keeping. A learning game is a complete game designed to teach, like a simulation or an adventure. Gamification takes something that is already a learning activity, such as a set of exercises, a course or a quiz, and adds game design elements to it: points, badges, leaderboards, levels, a story, avatars, teams. The activity is the same; the experience around it becomes more game-like.

This matters because the two are often lumped together, and the evidence for one does not automatically carry over to the other. For the evidence on full games, see the post on whether educational games work.

What went into the analysis

To be included, a study had to compare a gamified condition with a non-gamified one, use different groups of learners for each, measure at least one learning outcome, and report enough statistics to calculate an effect. The final sample was 38 publications reporting 40 experiments. The authors sorted the outcomes into three kinds:

  • Cognitive: what learners know or can do, usually measured with a test.
  • Motivational: how much learners want to engage, usually measured with questionnaires.
  • Behavioural: what learners actually do, such as how much they take part or how well they perform a skill.

The results

OutcomeEffect sizeExperimentsLearners
Cognitive0.49191,686
Motivational0.36162,246
Behavioural0.2510951
Sailer & Homner (2020); all three effects were statistically significant

All three effects were positive and significant, and the authors describe them as small. The effect on knowledge was the most robust: it held up when the analysis was limited to the most rigorous studies. The effects on motivation and behaviour did not survive that stricter test, partly because the rigorous subset was small. So the honest summary is that gamification reliably nudges learning in the right direction, and probably helps motivation and behaviour too, depending on how it is done.

Competition plus collaboration did best

The most useful findings are about which kind of gamification works. The authors coded how learners interacted: competing with each other, collaborating, a mix of both, or neither.

How learners interactedMotivationBehaviour
Competition only0.18 (not significant)0.12 (not significant)
Competition and collaboration together0.630.70
No social interaction0.38 (not significant)−0.06 (not significant)
Effect sizes by type of interaction, Sailer & Homner (2020)

For behaviour, the difference between the groups was statistically significant, and among the most rigorous studies the mixed condition beat pure competition. The authors’ own reading is that mere competition might be problematic for some learners in some circumstances, while competition augmented with collaboration can be effective. Their practical example is simple: let learners work together in teams while competing with other teams.

For knowledge, the type of interaction made no significant difference. Teams are not magic for test scores; their advantage shows up in how much learners engage and keep at it.

A story helps, sometimes

The second design choice the authors tested was game fiction: a story, a game world or a character for the learner. For knowledge and motivation it made no significant difference. For behaviour it did. Gamified designs with game fiction had an effect of 0.41 on behavioural outcomes; those without had 0.10, which was not significant.

The authors suggest a fictional world that runs through the whole activity, combined with avatars that learners can develop over time, as one way to put this into practice. A theme for a quiz session, a role for each team, or a character that progresses as students answer are smaller versions of the same idea.

Caveats from the authors

The authors are open about the limits. The number of eligible studies was small, so several comparisons rest on a handful of experiments, and some categories could not be tested at all. The effects varied a lot between studies. Behavioural outcomes were mostly measured inside the gamified activity itself, so they show that learners engaged more during the game, not necessarily that they behaved differently afterwards. And the question of which elements make gamification work for knowledge remains, in the authors’ words, partly unresolved.

Applying it to a class quiz

What the evidence suggests

  • Prefer teams for engagement. Teams competing against teams combine the two things that worked best together.
  • Keep competition friendly. Pure head-to-head competition had the weakest effects on motivation, so balance it with something shared.
  • Reward helping. The authors mention badges for helping and collaborating with others as one way to motivate.
  • Add a light theme. A story or a world can lift engagement, though it will not by itself raise test scores.
  • Do not expect miracles on grades. The benefit to knowledge is real but small; the questions themselves still do most of the teaching.

Many quiz tools already offer most of these as settings, from team play to themed game modes. The research suggests choosing them on purpose rather than by habit. For the case for and against competition in more depth, see is competition good for learning?

Sources

  1. Sailer, M. & Homner, L. (2020). The gamification of learning: A meta-analysis. Educational Psychology Review, 32(1), 77–112.

More from the blog

All posts →