Visual sound : interpretation and execution of inferred sounds in comics

Abstract

Little has been done to explore Visual Sound in the comics’ medium. This element predominantly consists of textual and visual cues. Research revolves around what can instigate different types of visual sounds in the medium, such as sound effects, descriptive sounds, speech balloons, thought balloons, picture balloons, body language, facial expressions and even motion lines. Four images were purposefully designed based on accumulated knowledge from a review of the literature. Three images were based on the most influential comic types in Malta, and a fourth was designed in the personal style of the researcher, replacing the Francophone style that was not indicated as being influential in Malta. Face-to-face interviews were carried out with a Comics Literate Group and a Comics Illiterate Group about these panels, after, they were asked to voice what sounds they perceived in the four panels. The Manga Panel tested sound effects, body language, expression and backgrounds; the British Panel explored descriptive sounds, speech and body language; the American Panel tested motion lines and visual scale; and the Painted Panel followed no existing style, but still employed techniques from the Francophone comic Asterix. It tested speech balloons, font use, body language and expressions. Results indicated that most participants were able to infer sounds according to what the image portrayed: yelling in the Manga Panel either in sound or speech; sounds of wind with motion lines in the American Panel; and speech in both British and Painted Panels. Descriptive Sound Effects were the least perceived. Some participants identified with and virtually took the place of characters, making their interpretation personal. All participants were able to identify sense of scale, colour and some aesthetic properties. Elements were primarily expressed in terms of emotive factors.