Talking Toys

While speech development starts early in life, the course of acquiring and processing language in a bilingual country like Malta is challenging. Engineers and language experts at the University of Malta have teamed up to build a toy that will help children overcome that hurdle. Words by Emanuel Balzan.

Toys and play are critical in children’s lives. It is through play that children learn how to interact with their environment and other people while developing their cognitive, speech, language, and physical skills. 

The way children play reveals many things including whether or not they are hitting particular development milestones. Play is also used by professionals who intervene when those skills are not acquired. Speech and language pathologists (SLP) use toys to tailor tasks based on their objectives for the child, determined following their assessment. For this reason, toys are vital tools. 

With technology moving at the rate it is, electronic components are easier and cheaper to access. As a result, a lot of smart, educational toys are now available on the market. However, Dr Ing. Philip Farrugia (Department of Industrial and Manufacturing Engineering, Faculty of Engineering, UM) honed in on a gap in the market—a smart toy that supports English and Maltese. 

Front left to right: Dr Ing. Owen Casha, Loridana Buttigieg, Emanuel Balzan, Dr Ing. Philip Farrugia, Prof. Helen Grech, Anthony Demanuele, Prof. Simon Fabri. Missing from the photo: Dr Daniela Gatt and James Attard.

To make this happen, Farrugia recruited a team of researchers from the university. Engineers Prof. Simon Fabri and Dr Owen Casha joined the effort. Researchers Prof. Helen Grech and Dr Daniela Gatt brought their expertise in speech and language acquisition and disorders. The team was finally complete when game development company Flying Squirrel Games stepped into the picture.

Getting down to business

The SPEECHIE project is divided into three stages. During the first phase, we sought to understand the process of speech and language acquisition, assessment, and therapy. We involved users through workshops that allowed us to observe children’s play and their toy preferences. We also conducted focus groups with parents to identify what they most wanted from toys. During these sessions, one parent noted how ‘there are not any [educational] toys in Maltese our little ones can play and interact with.’ Others agreed with this observation. Parents also raised concerns about children’s attraction to tablets and smartphones, noting how they interfered with social interaction. On the tail end of this discussion, one parent quickly added that ‘the toy must have something to make it feel like a toy and not a gadget.’

With further questioning, we also came to realise that different parents have different criteria when deciding to buy a toy. One parent told us that before buying a toy for her daughter, she would ‘try to see for how long she will play with it and what the toy will give her in return.’ Another parent, concerned about toys’ safety, checks for the CE mark (Conformité Européene) prior to purchasing the toy, saying that he associates the mark with better quality. However, he also confessed that ‘in the hands of children, nothing remains of quality. Give them something which is unbreakable and they will manage to break it in one way or another.’

Since our toy is intended for use in speech therapy, we went ahead and organised more focus groups with SLPs. Outlining the role of toys in their clinics, SLPs said ‘[they] are normally used as a reward. If you know that this child likes blocks, then you use them to motivate the child.’ Toys are also used as part of the language tasks SLPs give. ‘We use objects to put a grammatical structure in a sentence. Many times you find something that represents a noun, a verb, an object and then put them together’ to model the appropriate sentence construction. This prolific use of toys, however, brings with it a very practical problem. One SLP explained how challenging things can get on a day-to-day basis due to the lack of multipurpose toys. ‘We are always carrying toys… we are always carrying things around with us. Even our cars… it is like I have ten kids,’ she said.  

To address this issue, SLPs emphasised how useful it would be to have a flexible toy with multiple functions. One that does not bore children and which they can use to target different speech and language therapy goals. They also drew our attention to a prevalent but damaging mentality that they are trying to address. ‘Unfortunately, the majority of Maltese parents have a mentality that the more money they spend and the more therapy sessions for their children, the sooner the problem is alleviated, but in reality this is not true. The work needs to continue at home on a daily basis. It is not solely our responsibility,’ the SLP said. Much like when we practice daily to learn to play an instrument, speech and language therapy works the same way.

Sharon Borg, an experienced occupational therapist from the government’s Access to Communication and Technology Unit, said that the toy we had in mind could provide a simple way for parents to engage with their children and work at home on related exercises. Borg’s colleague, Ms May Agius, also noted the need for the toy to offer ‘surprises’, saying that ‘anticipation and elements of surprise draw kids and keep them engaged.’

Here we have only touched the surface of all the ideas brought forth. However, by considering the children’s, therapists’, and parents’ needs early in the engineering design process, we should be able to reduce the number of design iterations we have in future.

Reaching out

Design is key. Based on the feedback from the focus groups, we have now started working on the hardware and the software. But the journey is not straightforward. One issue we needed to deal with was the lack of compatibility between the 3D modelling software Flying Squirrel Games used and the technology used by the UM. From an academic point of view, because of the innovative nature of the toy we are making, we needed flexibility, so we modified Flying Squirrel’s virtual model to add different mechanisms which involve moving parts. These alterations now allow us to create support to fix electronic components within the device and ensure that no moving part is impeded by another part. As a result, assembly is much easier. 

Emanual Balzan and Dr Ing. Philip Farrugia

We have also made the decision to build SPEECHIE software using modular blocks. This will enable us to switch parts and functions around so we can widen the idea of who might enjoy our product. The toy will not only be of use to children with speech and language impairments, but also to others. This approach was inspired by a meeting with behavioural economist Dr Marie Briguglio who warned us that labelling the toy could be stigmatising. She explained that it should not become ‘an isolated toy which kind of becomes a label: because I have this toy, that means I have speech impairment.’  

Despite the aversion some parents felt towards technological devices, as said during focus groups, Borg also encouraged us not to shy away from using them. She said children with autism responded very well to technology, and therapists will make the best choice for the child to improve their skills. To hit a sweet spot in between these views, we are incorporating functions that will allow for a kinesthetic learning experience that involves physical activities rather than passive consumption of instructions. We want to mix different modes of play to encourage effective learning. We do not want kids to sit and watch their toy, but to move around, dance, and sing with other children. 

With all of these choices under our belt, we now have a working prototype. But the SPEECHIE toy is not yet complete. In fact, the coming months will see us working on the mechanisms and the interfacing of electronics. 

Towards the end of the year, we will start putting the toy into preschoolers’ hands to determine its effectiveness and efficiency in regard to speech and language therapy. To do this, we will compare the progress of children who use SPEECHIE with those who only use traditional SLP methods.

What we hope is that this toy will encourage parent-and-child interaction through play. We want to enable more frequent use of both Maltese and English and allow children to be safely exposed to technology and to a fantastic learning experience—all while having a ball.  

Note: We are excited to share these insights about SPEECHIE with the public, and if you would be interested in joining on this journey by participating in the evaluations, get in touch here: speechie-web@um.edu.mt

This research is financed by the Malta Council for Science and Technology (MCST) through the FUSION Technology Development Programme 2016 (R&I-2015-042-T).

Author: Emanuel Balzan

Beyond Lab Coats and Microscopes

Giuliabugeja-300x136Pride. That’s what Enrico felt when his name was announced at the Science Expo as the winner of the NSTF Contest for young scientists. The contest is a first step helping to build what Enrico Zammit Lonardelli calls his ‘scientific character’. It is a journey that led him to compete on an international level in Milan to represent Malta, meet and talk to incredible people, and learn about the way in which science is carried out all over the world. Feelings of honour, fulfilment, and success quickly followed. ‘Being surrounded by the best people in Europe in all possible aspects and fields of science was simply amazing.’

Taking on such challenges in the scientific world at only 17, Zammit is the younger mirror image of another 17 year old that, around 20 years earlier, started the same journey. Today lecturer Conrad Attard (Faculty of ICT, University of Malta; Vice Chair, IEEE Malta Section) is handling several activities, one of which is an exhibit with his team for the same Science Expo which started Enrico off on his scientific voyage.

20084_883971005002679_829620880923076354_nAttard sees the Expo as a great way to distribute resources, and meet kids and visitors. ‘I want students to get excited about science and for more students to engage with these subjects’. That’s why Attard always teaches them in a fun way, by creating games were students need to solve logic problems that involve science and computing to learn and achieve their goals, and that is exactly what his exhibit at the NSTF Expo does.

So why is the growth of science communication important in Malta? For Attard, it is all about helping people find out what they do well in and pushing students to reach out beyond their comfort zone and that mistakes are part of the learning experience.

Zammit understands this principle. Some of his family members suffer from asthma motivating him to research it for the NSTF Expo. ‘Slowly I managed to understand the mechanism and a few questions popped into my mind. The following process was turning those questions into a project by research, planning, and finally experimentation.’

By favouring the multidisciplinary approach students are not limited to only becoming developers, but can also tackle related problems requiring knowledge or skills from other disciplines. This is what attracted Attard to the NSTF Science Expo as it uses crafts, different skills, and logic to solve problems.

10156054_883970715002708_5798862449868254838_nAccording to Zammit, the NSTF Expo and Programmes focus on analytical skills, public speaking, problem solving techniques, planning, critical thinking, creativity, and descriptive writing. ‘They all focus on character development rather than just the activity and provide an ensemble of quality development which is simply impossible to match by reading books and studying’. And, of course, there are amazing prizes.

The Expo gave Zammit a platform for his work to be recognised by experts. ‘It has since motivated me to work harder because now I know what it feels like to win and create something useful. I want to repeat this success, hopefully at larger scales with ever bigger projects and aims.’

Maybe one day, it will be Zammit who will find himself teaching young students about science at the NSTF Expo.

The next NSTF Science Expo will be from 9–16 March for school visits, while the open weekend for everybody else will be on the 12–13 March.

For more information visit the NSTF Malta website or Facebook page.

Writing Maltese Sign language

Dr Maria Galea writes about her journey into the world of Maltese Sign Language and bringing a logical framework to the written form of the language. This work has the potential to empower the approximately 400 deaf people in Malta.

Continue reading