Please use this identifier to cite or link to this item: https://www.um.edu.mt/library/oar/handle/123456789/22949
Title: Towards gaze-controlled platform games
Authors: Munoz, Jorge
Yannakakis, Georgios N.
Mulvey, Fiona
Hansen, Dan Witzner
Gutierrez, German
Sanchis, Araceli
Keywords: Human-computer interaction
Computer games
Issue Date: 2011
Publisher: Institute of Electrical and Electronics Engineers Inc.
Citation: Munoz, J., Yannakakis, G. N., Mulvey, F., Witzner, D., Gutierrez G., & Sanchis, A. (2011). Towards gaze-controlled platform games. 2011 IEEE Conference on Computational Intelligence and Games, Seoul.
Abstract: This paper introduces the concept of using gaze as a sole modality for fully controlling player characters of fast-paced action computer games. A user experiment is devised to collect gaze and gameplay data from subjects playing a version of the popular Super Mario Bros platform game. The initial analysis shows that there is a rather limited grid around Mario where the efficient player focuses her attention the most while playing the game. The useful grid as we name it, projects the amount of meaningful visual information a designer should use towards creating successful player character controllers with the use of artificial intelligence for a platform game like Super Mario. Information about the eyes' position on the screen and the state of the game are utilized as inputs of an artificial neural network, which is trained to approximate which keyboard action is to be performed at each game step. Results yield a prediction accuracy of over 83% on unseen data samples and show promise towards the development of eye-controlled fast-paced platform games. Derived neural network players are intended to be used as assistive technology tools for the digital entertainment of people with motor disabilities.
URI: https://www.um.edu.mt/library/oar//handle/123456789/22949
Appears in Collections:Scholarly Works - InsDG

Files in This Item:
File Description SizeFormat 
paper13.pdf680.94 kBAdobe PDFView/Open


Items in OAR@UM are protected by copyright, with all rights reserved, unless otherwise indicated.