Felt qualities of experience in gestural enactments of film sound

Based on film retellings by 11 German native speakers, gestural re-/presentations of sound experience were analyzed in terms of spatial and temporal features with the help of the motion-capture system. When describing sounds stemming from a cinematic context, study participants conveyed sound qualities and re-experienced sensations through co-speech gestures. Our findings put into relief ways in which felt qualities of this experience are expressed through gestural enactment. The approach presented in this paper aims to contribute to an embodied account of sound experience and multimodal expression.

  • Rekittke, Linn-Marlen, Wolf, Dhana & Mittelberg, Irene (2015). How sound moves the body: Felt qualities of experience in gestural enactments of film sound. In: Proceedings of the 3rd Gesture and Speech in Interaction (GESPIN) Conference, Sept. 2015, Nantes.