Guiding automated web test case generation using HCI techniques

Abstract

Software testing is an essential activity performed in the industry where software systems are validated for their intended level of quality and in identifying any existing inconsistencies. Considering that company reputation and client confidence relies on having such systems operating as intended, the art of software testing is continuously given a high priority. This is also evidently shown in the industry through the adaptation and implementation of test case generation techniques, such as Symbolic Execution, Search Based Software Testing and Model Based Testing. However, research highlights numerous issues which are hindering the effectiveness of such techniques when applied in the real world. One of the key issues within the current test case generation techniques is the ability to provide maximum coverage which includes statement and branch coverage. Such techniques have demonstrated that despite having high coverage, this is still resulting in a number of undiscovered bugs. Another important issue, as yet unresolved, is the automatic inclusion of domain knowledge and tester expertise within the test case generation process. This also results in the oracle problem, since there are no fully automated means of validating such test cases for correctness. The aim of this dissertation is to attempt to overcome the aforementioned limitations by utilising Human Computer Interaction (HCI) techniques within the automated test case generation process. This is done by speci cally capturing human behaviours expressed by testers, such as facial expressions, eye and mouse movement. Human behaviours ultimately provide guidance to the generation of more effective test cases. A case study was performed to demonstrate how the applied methodology yielded test cases capable of uncovering more bugs than state-of-the-art test case generation techniques.