← Search

Two Sides of the Same Coin

Spencer D. Kelly¹; Aslı Özyürek^2,3; Eric Maris^4,5

¹ Department of Psychology, Neuroscience Program, Colgate University · ² Department of Linguistics, Radboud University Nijmegen · ³ Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands · ⁴ Donders Institute for Brain, Cognition and Behaviour, Center for Cognition, Radboud University Nijmegen · ⁵ Donders Center for Cognitive Neuroimaging, Radboud University Nijmegen

Gesture and speech are assumed to form an integrated system during language production. Based on this view, we propose the integrated-systems hypothesis, which explains two ways in which gesture and speech are integrated—through mutual and obligatory interactions—in language comprehension. Experiment 1 presented participants with action primes (e.g., someone chopping vegetables) and bimodal speech and gesture targets. Participants related primes to targets more quickly and accurately when they contained congruent information (speech: “chop”; gesture: chop) than when they contained incongruent information (speech: “chop”; gesture: twist). Moreover, the strength of the incongruence affected processing, with fewer errors for weak incongruities (speech: “chop”; gesture: cut) than for strong incongruities (speech: “chop”; gesture: twist). Crucial for the integrated-systems hypothesis, this influence was bidirectional. Experiment 2 demonstrated that gesture’s influence on speech was obligatory. The results confirm the integrated-systems hypothesis and demonstrate that gesture and speech form an integrated system in language comprehension.

DOI

10.1177/0956797609357327

Volume

21 (2)

Pages

260-267

Language

en

Export

BibTeX

Sources

crossref