Back to Search

Multimodal encoding of motion events in speech, gesture and cognition

Title	Multimodal encoding of motion events in speech, gesture and cognition
Author	Ünal, Ercenur, Mamus, E., Özyürek, A.
Publication Date:	2023-12
Publication Place	- Cambridge University Press
Subject	Cross-linguistic differences, Event cognition, Event integration, Gesture, Motion events, Multimodal language
Type	Periodical
Language	English
Digital	Yes
Manuscript	No
Library:	Özyeğin University
Library Asset ID	1866-9808
Record ID	2340ad04-e7cd-4308-983a-355f08d7e980
Library Location	Psychology
Date	2023-12
Sample Text	How people communicate about motion events and how this is shaped by language typology are mostly studied with a focus on linguistic encoding in speech. Yet, human communication typically involves an interactional exchange of multimodal signals, such as hand gestures that have different affordances for representing event components. Here, we review recent empirical evidence on multimodal encoding of motion in speech and gesture to gain a deeper understanding of whether and how language typology shapes linguistic expressions in different modalities, and how this changes across different sensory modalities of input and interacts with other aspects of cognition. Empirical evidence strongly suggests that Talmy's typology of event integration predicts multimodal event descriptions in speech and gesture and visual attention to event components prior to producing these descriptions. Furthermore, variability within the event itself, such as type and modality of stimuli, may override the influence of language typology, especially for expression of manner.
DOI	10.1017/langcog.2023.61

View in source Özyeğin University Özyeğin University - Historical works, archives, and periodicals search engine

Özyeğin University

Multimodal encoding of motion events in speech, gesture and cognition

Author Ünal, Ercenur, Mamus, E., Özyürek, A.

Publication Date 2023-12

Publication Place - Cambridge University Press

Subject Cross-linguistic differences, Event cognition, Event integration, Gesture, Motion events, Multimodal language

Type Periodical

Language English

Digital Yes

Manuscript No

Library Özyeğin University

Library Asset ID 1866-9808

Record ID 2340ad04-e7cd-4308-983a-355f08d7e980

Library Location Psychology

Date 2023-12

Sample Text How people communicate about motion events and how this is shaped by language typology are mostly studied with a focus on linguistic encoding in speech. Yet, human communication typically involves an interactional exchange of multimodal signals, such as hand gestures that have different affordances for representing event components. Here, we review recent empirical evidence on multimodal encoding of motion in speech and gesture to gain a deeper understanding of whether and how language typology shapes linguistic expressions in different modalities, and how this changes across different sensory modalities of input and interacts with other aspects of cognition. Empirical evidence strongly suggests that Talmy's typology of event integration predicts multimodal event descriptions in speech and gesture and visual attention to event components prior to producing these descriptions. Furthermore, variability within the event itself, such as type and modality of stimuli, may override the influence of language typology, especially for expression of manner.

DOI 10.1017/langcog.2023.61