Download
1 / 49
490 likes | 495 Views
Traditional validation is thorough and slow, and does not comply with the fast and agile development of games. Successful games need to be both validated and profitable. This talk is about our quest for strategies that let us develop agile, but thorough on effectiveness and safety at the same time. Our games have been subject to validation studies for over a decade. This used to be done by researchers in universities with our finished products. Whatever the outcome would be, was uncertain and if it were to be negative we couldn’t do anything about it anyway. In 2010 we delivered a game for training medical specialists to stabilize patients with the “abcde method”. This game was validated by the Erasmus university with traditional validation strategies. The results (positive) came out in 2015. In the mean time we were working on the 7th expansion of the game and it had been accredited to the highest level for several years. First of all, in a typical lifetime of a game the time it takes to validate anything with traditional methods just takes too long. Second the traditional methods like RCT are primarily developed for drag validation and not very suitable for complex interventions like games. We set out to look for new strategies with experts from different institutions and (medical) universities. After several attempts and iterations, we are now applying a strategy for validation in which every iteration of the game, from paper prototype to beta-version is subject to a test (as we have been doing in game development for years) that is designed not only for gameplay and usability purposes, but also complies to the academic rules for validation. We have been doing this with a game for the prevention of PTSD with the Free University of Amsterdam with very promising results. We have just started a new project with Radboud University and Trimbos Institute about depression with High schoolers, and we will start with an awareness game for Dementia with the Geriatric Centre of the Academic Medical Centre in Groningen.
E N D
Making it Work Validation of applied games
Introduction Evert Hoogendoorn
Behaviour action!
Games designing for behaviour
High System E-learning High Empathy Low Empathy Traditionele School Classroom Low System
Opportunity… to lose users second line of opportunity 2 first line of opportunity being able to play technical requirement intention to play ambassadors management communication 1 third line of opportunity 3 ! play reason to play intuitive controls pre-ludo opportunity 4 designing, testing & development people on the team fourth line of opportunity 0 transfer application in RL
The Big Game Communication Little Game (tool) Pre-game (tool) Post-game (tool) Transfer
Solve a problem don’t design a solution
Validation Learning by doing
Briljant idea Implemen- tation Plan Development
Fail Fast Briljant idea Implemen- tation Prototype Playtest Development Best Practise Validation Loop
2015 •validated •5 games •highest accreditation •used in NL, UK, Germany, Oman •learnings couldn’t be implemented
Existing theories Briljant idea Prototype Playtest Development Validation Best Practise
Existing theories Briljant idea Implemen- tation Prototype Playtest Development Best Practise
Existing theories Briljant idea Implemen- tation Prototype Pilot RCT's Development Best Practise
Mental Health Literacy “Knowledge and beliefs about mental disorders which aid their recognition, management or prevention” (Jorm, et al, 1997). (a) knowledge of how to prevent mental disorders, (b) recognition of when a disorder is developing, (c) knowledge of help-seeking options and treatments available, (d) knowledge of effective self-help strategies for milder problems, and (e) first aid skills to support others who are developing a mental disorder or are in a mental health crisis” (Jorm, 2012).
Existing theories Briljant idea Implemen- tation Prototype Playtest Development Best Practise
Existing theories Briljant idea Implemen- tation Prototype Pilot RCT's Development Best Practise Pragmatic trial
Validation of games is • about commercial and academic riskmanagement • evidence based, practise led • about fast failing / agile / iterative (just like development) • integrated in de developmentproces
Thank You evert@ijsfontein.nl
