Speaking and gesturing guide event perception during message conceptualization: Evidence from eye movements

Name: Speaking and gesturing guide event perception during message conceptualization: Evidence from eye movements
Author: Ünal, Ercenur, Manhardt, F., Özyürek, A.

İsim	Speaking and gesturing guide event perception during message conceptualization: Evidence from eye movements
Yazar	Ünal, Ercenur, Manhardt, F., Özyürek, A.
Basım Tarihi:	2022-08
Basım Yeri	- Elsevier
Konu	Gesture, Motion events, Multimodal language production, Thinking for speaking, Visual attention
Tür	Süreli Yayın
Dil	İngilizce
Dijital	Evet
Yazma	Hayır
Kütüphane:	Özyeğin Üniversitesi
Demirbaş Numarası	0010-0277
Kayıt Numarası	08a2efe1-d914-45a8-a16a-92a48734f7ce
Lokasyon	Psychology
Tarih	2022-08
Notlar	NWO-VICI ; Nederlandse Organisatie voor Wetenschappelijk Onderzoek
Örnek Metin	Speakers' visual attention to events is guided by linguistic conceptualization of information in spoken language production and in language-specific ways. Does production of language-specific co-speech gestures further guide speakers' visual attention during message preparation? Here, we examine the link between visual attention and multimodal event descriptions in Turkish. Turkish is a verb-framed language where speakers' speech and gesture show language specificity with path of motion mostly expressed within the main verb accompanied by path gestures. Turkish-speaking adults viewed motion events while their eye movements were recorded during non-linguistic (viewing-only) and linguistic (viewing-before-describing) tasks. The relative attention allocated to path over manner was higher in the linguistic task compared to the non-linguistic task. Furthermore, the relative attention allocated to path over manner within the linguistic task was higher when speakers (a) encoded path in the main verb versus outside the verb and (b) used additional path gestures accompanying speech versus not. Results strongly suggest that speakers' visual attention is guided by language-specific event encoding not only in speech but also in gesture. This provides evidence consistent with models that propose integration of speech and gesture at the conceptualization level of language production and suggests that the links between the eye and the mouth may be extended to the eye and the hand.
DOI	10.1016/j.cognition.2022.105127
Cilt	225

Kaynağa git Özyeğin Üniversitesi

Aramaya Dön

Özyeğin Üniversitesi

Kaynağa git

Speaking and gesturing guide event perception during message conceptualization: Evidence from eye movements

Yazar Ünal, Ercenur, Manhardt, F., Özyürek, A.

Basım Tarihi 2022-08

Basım Yeri - Elsevier

Konu Gesture, Motion events, Multimodal language production, Thinking for speaking, Visual attention

Tür Süreli Yayın

Dil İngilizce

Dijital Evet

Yazma Hayır

Kütüphane Özyeğin Üniversitesi

Demirbaş Numarası 0010-0277

Kayıt Numarası 08a2efe1-d914-45a8-a16a-92a48734f7ce

Lokasyon Psychology

Tarih 2022-08

Notlar NWO-VICI ; Nederlandse Organisatie voor Wetenschappelijk Onderzoek

Örnek Metin Speakers' visual attention to events is guided by linguistic conceptualization of information in spoken language production and in language-specific ways. Does production of language-specific co-speech gestures further guide speakers' visual attention during message preparation? Here, we examine the link between visual attention and multimodal event descriptions in Turkish. Turkish is a verb-framed language where speakers' speech and gesture show language specificity with path of motion mostly expressed within the main verb accompanied by path gestures. Turkish-speaking adults viewed motion events while their eye movements were recorded during non-linguistic (viewing-only) and linguistic (viewing-before-describing) tasks. The relative attention allocated to path over manner was higher in the linguistic task compared to the non-linguistic task. Furthermore, the relative attention allocated to path over manner within the linguistic task was higher when speakers (a) encoded path in the main verb versus outside the verb and (b) used additional path gestures accompanying speech versus not. Results strongly suggest that speakers' visual attention is guided by language-specific event encoding not only in speech but also in gesture. This provides evidence consistent with models that propose integration of speech and gesture at the conceptualization level of language production and suggests that the links between the eye and the mouth may be extended to the eye and the hand.

DOI 10.1016/j.cognition.2022.105127

Cilt 225