Effective evaluation for basic skills e-learning programmes : a conceptual framework and practical process

Abstract

A rigorous and well-planned evaluation process is critical. Poorly designed evaluations, on the other hand, do not help in improving an e-learning programme. Through a review of the literature, the author develops an original working model that can be used by e-trainers, designers and SME owners to measure the quality of the learning in online courses. The reliability and validity of the model is tested through an action research project involving key stakeholders, namely an online trainer and participants – workers from a Maltese SME. The results of the project that will be presented in the paper suggest that the evaluation process must address a number of methodological problems, including the need for measures other than standardized achievement tests, differences among students about their needs and expectations of learning, differences in learning and teaching styles, and program implementation. The paper ends with suggestions and recommendations for future research. As the need to help workers lacking basic skills increases (particularly due to the rapid digitilisation of the workplace), and this can mainly be achieved through alternative learning initiatives, the evaluation model proposed in this paper may assist policymakers, planners, funding agencies, designers and providers, and more importantly eeducators, in making reasonable and informed judgments with regard to the quality of learning in webbased distance education.