Playtest
☻Qualitative Method:
Explore how players feel and behave through interviews, observations, and open-ended feedback. (with optional quantitative metrics)
​
Best Stage: Prototype → Beta
Primary Goal: Observing how players actually play, identifying friction, confusion, and moments of delight
Effort: Moderate
Overview
Direct observation is one of the most powerful tools in a game researcher’s toolkit. It offers immediate insight into how players interact with a game, often revealing issues that self-report methods like surveys may miss. Observational data tends to be less prone to bias, making it essential for understanding the actual player experience.
Planning the Observation
To run an effective observation session, preparation is key. You need to be clear on two things:
What you’re observing – Define the specific behaviors, interactions, or moments in the game you want to study.
How you’ll document it – Decide on your note-taking method, screen recording tools, or tagging systems in advance.
Steps to Prepare:
-
Clarify research objectives and business goals.
Understand what stakeholders need to learn from the test.
-
Understand the game content and experience.
Know the player journey well enough to anticipate potential confusion or friction points.
-
Identify key moments where the experience may break down.
Focus on areas where players might misunderstand mechanics, become lost, or fail to engage.
Once you’ve identified your study goals, reframe them as observation questions. This makes them easier to track and evaluate during the session:
-
Clarity – Can players figure out what to do and how to do it?
-
Wayfinding – Can players navigate the space and find where to go?
-
Difficulty – Are players struggling in ways the game didn't intend?
Conducting the Observation
-
Observed playtests can happen in various formats:
-
Remote: Players share their screen, and you can also record webcam footage for facial reactions.
-
In-person: Conducted in a lab setting or even in the player’s home for more natural behavior.
What to Observe
In-Game Events
These are the most important. Watch for moments where players hesitate, repeat actions, seem stuck, or deviate from the intended path.
Control Inputs
Watching inputs (keyboard, mouse, controller, touchscreen) can be helpful. Tracking inputs can reveal misunderstandings (e.g., button-mashing or repeated wrong actions).
Player Comments
Listen for spontaneous reactions, frustrated sighs, swearing, or confusion. These moments are great entry points to probe further: “What was going through your mind when that happened?”
Body Language
Non-verbal cues like leaning forward, frowning, smiling can offer additional insight but should be interpreted cautiously. Not all frustration is bad (sometimes it’s part of the fun), and some players express excitement in understated ways.