Original scientific paper
https://doi.org/10.22210/suvlin.2024.098.02
The (in)congruence effect of co–speech gestures on language processing
Emilija Mustapić Malenica
; Department of English Studies, University of Zadar
*
* Corresponding author.
Abstract
The aim of this paper is to explore the phenomenon of co–speech gestures in language processing.
As gestures have often been analysed predominantly within the paradigm of the rhetorical tradition, this paper will try to portray their psycholinguistic dimension, which has become increasingly
important within the domain of linguistic research. Through use of experimental psycholinguistic
methodology and the priming paradigm, I have compared the speed and accuracy of processing of
linguistic utterances occurring only in the audio–visual modality accompanied by congruent and
incongruent co–speech gestures. The results of the experiment confirmed the hypothesis that incongruence of co–speech gestures has an inhibitory effect on speed and accuracy of processing of
the multimodal linguistic message. The participants’ reaction times were slower and accuracy rates
lower in conditions in which the semantic congruence between the verbal and the gestural modality
was nullified, and the same effect was noticed in both the native language and the first foreign language. This result speaks in favour of the claim that the verbal and gestural representational systems
are interconnected and constitute a holistic picture of the mental process.
Keywords
(in)congruent co–speech gestures; multimodality; language processing; mental processing
Hrčak ID:
324628
URI
Publication date:
20.12.2024.
Visits: 0 *