Please use this identifier to cite or link to this item:
Title: Experience surveillance suite for unity 3D
Authors: Dingli, Alexiei
Giordimaina, Andreas
Martinez, Hector P.
Keywords: Computer games
Image processing
Human-computer interaction
Heart rate monitoring
Issue Date: 2015
Publisher: Institute of Electrical and Electronics Engineers Inc.
Citation: Dingli, A., Giordimaina, A., & Martinez, H. P. (2015). Experience surveillance suite for unity 3D. 7th International Conference on Games and Virtual Worlds for Serious Applications (VS-Games), Skovde. 1-6.
Abstract: Monitoring the emotional state of players in games can get quite complex, taking into consideration that the game context affects the player and that a game may contain various emotional features. Furthermore, since the experience of playing a game occurs unconsciously, methods such as think aloud may interrupt the playing experience. Other methods include fitting cables and electrodes to the player in order to monitor measurements such as heart rate. Although such devices can offer significant results, they are not commonly found and may cause discomfort. In this project we propose a webcam-based heart rate monitoring method that can be used to predict the player's emotional state. The first objective was to analyze the heart rate changes with respect to the players' emotional state. The evaluation resulted in positive results, where the heart rate showed correlation with the following emotional states; frustration, fun, challenge and boredom. The second objective was to create a webcam-based method to monitor the heart rate. This was performed by extracting the RGB channels from the face region and then retrieving the underlying components using a dimensionality reduction method. Although the results obtained from the webcam-based method were not ideal, this was expected taking into consideration that the method was tested under realistic scenarios. The last objective was to predict the player's emotional state using the heart rate obtained from the webcam-based method. The accuracy of the prediction was up to 76%, which exceeds the aim of the project. Finally, by using the evaluation results it was possible to define a set of approaches on how this project can be extended by future researchers.
Appears in Collections:Scholarly Works - FacICTAI

Files in This Item:
File Description SizeFormat 
Experience Surveillance Suite for Unity 3D.pdf
  Restricted Access
Experience surveillance suite for unity 3D25.93 MBAdobe PDFView/Open Request a copy

Items in OAR@UM are protected by copyright, with all rights reserved, unless otherwise indicated.