"Seltsames Paar" by Emil Nolde

"Strange MoCap Couple"
by Natural Media Lab

Mapping Multimodal Dialogue

Workshop Program

Friday, November 22

08:30-09:15 Registration & coffee
09:15-09:30 Welcome remarks
Session 1: Multimodal Pragmatics I
09:30-10:00 Cornelia Müller (Europa-Universität Viadrina Frankfurt/Oder)
Emerging metaphoricity and the moving of gestural expressivity in dialogue
10:00-10:30 Kashmiri Stec (University of Groningen)
Meaningful shifts: Viewpoint in multimodal narrative
10:30-11:00 Camille Debras (Sorbonne Nouvelle Paris 3)
Shrugging as stancetaking: forms and functions of a compound enactment
11:00-11:30 Coffee & tea break
Session 2: Embodied Grammar I
11:30-12:00 Maarten Lemmens (Université de Lille 3)
Contrastive perspectives on static location in lexis and gesture
12:00-12:30 Jennifer A. J. Hinnell (University of Alberta)
Gestural iconicity in quantitative measures: a corpus study of English periphrastic auxiliaries
12:30-13:00 Paul Sambre, Geert Brône (KU Leuven)
Cut and break. The multimodal expression of instrumentality and causality
13:00-13:30 Kasper Kok (VU Amsterdam)
What is multimodal grammar anyway? A view from quantitative corpus analysis
13:30-14:30 Lunch break

Session 3: Multimodal Alignment
14:30-15:00 Lucas Bietti (Telecom ParisTech), Kasper Kok, Alan Cienki (VU Amsterdam)
Mapping behavioral alignment: from everyday collaborative activities to agent-based models
15:00-15:30 Kirsten Bergmann (Universität Bielefeld)
Gestural alignment in human-human and human-computer dialogue
15:30-16:00 Harald Skomroch, Hedda Lausberg (Deutsche Sporthochschule Köln), Volker Unterladstetter, Meytal Sandler, Jan Strunk, Nikolaus P. Himmelmann (Universität zu Köln)
Aligning hand movement behaviour and intonation sequences
16:00-16:30 Coffee & tea break
16:30-17:00 Geert Brône, Kurt Feyaerts, Bert Oben (KU Leuven)
Eye-gaze and gesture in multimodal turn-taking
17:00-17:30 Bert Oben (KU Leuven)
Multimodal construal in dyadic interactions: the role of interactive alignment
Session 4: Neuroscientific Perspectives
Hedda Lausberg, Harald Skomroch, Nadine Gabor (Deutsche Sporthochschule Köln)
Nonverbal communication in psychotherapy (cancelled)
17:30-18:00 Linn Rekittke, Dhana Wolf (RWTH Aachen)
Applying Peirce's Universal Categories to co-speech gesture and a first road map to social neuroscience
18:00-18:30 Discussion

Saturday, November 23

Session 5: Multimodal Pragmatics II
09:00-09:30 Mathilde Peyré (Université de Lille 3)
Beat-like gestures use in different types of speech in American English
09:30-10:00 Sabina Tabacaru (Université de Lille 3, KU Leuven)
A multi-modal approach to humor
10:00-10:30 Matthias A. Priesters, Irene Mittelberg (RWTH Aachen)
On the spherical nature of gesture spaces: Insights from visualized kinetic action
10:30-11:00 Coffee & tea break
Session 6: Embodied Grammar II
11:00-11:30 Steven Schoonjans, Kurt Feyaerts, Geert Brône (KU Leuven)
Analyzing German modal particles as multimodal constructions
11:30-12:00 Suwei Wu (VU Amsterdam)
Theoretical exploration for Construction Grammar of spoken language and multimodality
12:00-12:30 Katja Abramova (Radboud University Nijmegen)
From gestures to sign languages in the lab: Challenges and perspectives
12:30-13:00 Discussion and closing remarks
15:00-17:00 Motion Capture demo at Natural Media Lab (HumTec)