EN GUARDE VR: developing next-generation sensor tracking for VR and AR

EN GUARDE VR (Exploring our interactive heritage through sword-fighting education in Virtual Reality) is a new project funded by Xjenza Malta and coordinated by the Institute of Digital Games launching in October 2026.

The project combines cutting-edge tech, game design, and historical heritage with the Institute of Digital Games, Draw and Code Labs, and the Malta Historical Fencing Association collaborating to develop and test the next generation of Augmented Reality (AR) and Virtual Reality (VR) applications.

Innovation in Virtual Reality

Despite massive leaps in Virtual Reality (VR) that led to better, cheaper, lighter headsets, precise body and hand tracking without specialized equipment remains a major hurdle for the industry. EN GUARDE VR aims to improve sensors and systems for hand and body tracking as well as use this data to directly feed into the user's pose and actions, translating users’ movements into fluid game actions.

Sword Fighting Challenge in VR

Historical sword fighting offers an ideal test-case for the technology targets: it relies on accurate hand positioning and posture but is also a fast-paced competition between two contestants.

Simultaneously tracking body and hand movements of two interacting players is under-researched, and forms a research objective for EN GUARDE VR with broader applications in contact sports, technology-enhanced learning, and immersive arts.

An example of a real-life application of AR in sports is the Perfect Play app, developed by Draw and Code and Chelsea FC to help players and fans to train like a pro from home.

While providing a rigorous test case for the developed technology, using historical fencing as a test-case for the technology also allows for the preservation and study of intangible heritage. The techniques encoded in the game and detected by the sensors are derived from classic texts, including several from the National Library in Valletta such as Di Grassi’s Ragione di adoprar sicuramente l’Arme, si da offesa come da difesa and Agrippa’s Trattato di Scienza D’Arme.

To find out more subscribe to the EN GUARDE VR Newsletter and receive invitations to the playtesting sessions and dissemination events throughout the project.