期刊
SOCIAL COGNITIVE AND AFFECTIVE NEUROSCIENCE
卷 10, 期 2, 页码 255-261出版社
OXFORD UNIV PRESS
DOI: 10.1093/scan/nsu047
关键词
co-speech gestures; speech-gesture integration; eye gaze; communicative intent; middle temporal gyrus
资金
- Marie Curie Fellowship [255569]
- European Research Council Advanced Grant INTERACT [269484]
- European Research Council Starting Grant [240962]
- VICI grant from the Nederlandse Organisatie voor Wetenschappelijk Onderzoek [453-08-002]
- European Research Council (ERC) [240962] Funding Source: European Research Council (ERC)
Recipients process information from speech and co-speech gestures, but it is currently unknown how this processing is influenced by the presence of other important social cues, especially gaze direction, a marker of communicative intent. Such cues may modulate neural activity in regions associated either with the processing of ostensive cues, such as eye gaze, or with the processing of semantic information, provided by speech and gesture. Participants were scanned (fMRI) while taking part in triadic communication involving two recipients and a speaker. The speaker uttered sentences that were and were not accompanied by complementary iconic gestures. Crucially, the speaker alternated her gaze direction, thus creating two recipient roles: addressed (direct gaze) vs unaddressed (averted gaze) recipient. The comprehension of Speech&Gesture relative to SpeechOnly utterances recruited middle occipital, middle temporal and inferior frontal gyri, bilaterally. The calcarine sulcus and posterior cingulate cortex were sensitive to differences between direct and averted gaze. Most importantly, Speech&Gesture utterances, but not SpeechOnly utterances, produced additional activity in the right middle temporal gyrus when participants were addressed. Marking communicative intent with gaze direction modulates the processing of speech-gesture utterances in cerebral areas typically associated with the semantic processing of multi-modal communicative acts.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据