Replay Analysis in Open-Ended Educational Games
Serious Game Analytics: Methodologies for Performance Measurement, Assessment, and Improvement
2015
Abstract
Designers of serious games have an interest in understanding if their games are well-aligned, i.e., whether in-game rewards incentivize behaviors that will lead to learning. Few existing serious games analytics solutions exist to serve this need. Open-ended games in particular run into issues of alignment due to their affordances for wide player freedom. In this chapter, we first define open-ended games as games that have a complex functional solution spaces. Next, we describe our method for exploring alignment issues in an open-ended educational game using replay analysis. The method uses multiple data mining techniques to extract features from replays of player behavior. Focusing on replays rather than logging play-time metrics allows designers and researchers to run additional metric calculations and data transformations in a post hoc manner. We describe how we have applied this replay analysis methodology to explore and evaluate the design of the open-ended educational game RumbleBlocks. Using our approach, we were able to map out the solution space of the game and highlight some potential issues that the game’s designers might consider in iteration. Finally, we discuss some of the limitations of the replay approach.
BibTeX
@inproceedings{harpstead-sga-2015,
title = {Replay Analysis in Open-Ended Educational Games},
author = {Harpstead, Erik and MacLellan, Christopher J. and Aleven, Vincent and Myers, Brad A.},
booktitle = {Serious Game Analytics: Methodologies for Performance Measurement, Assessment, and Improvement},
year = {2015},
doi = {10.1007/978-3-319-05834-4_17},
}