Actions speak no louder than words: Symmetrical cross-modal interference effects in the processing of verbal and gestural information

Citation

Langton S, O'Malley C & Bruce V (1996) Actions speak no louder than words: Symmetrical cross-modal interference effects in the processing of verbal and gestural information. Journal of Experimental Psychology: Human Perception and Performance, 22 (6), pp. 1357-1375. https://doi.org/10.1037/0096-1523.22.6.1357

Abstract
Five experiments are reported that investigate the distribution of selective attention to verbal and nonverbal components of an utterance when conflicting information exists in these channels. A Stroop-type interference paradigm is adopted in which attributes from the verbal and nonverbal dimensions are placed into conflict. Static directional (deictic) gestures and corresponding spoken and written words show symmetrical interference (Experiments 1, 2, and 3), as do directional arrows and spoken words (Experiment 4). This symmetry is maintained when the task is switched from a manual keypress to a verbal naming response (Experiment 5), suggesting the mutual influence of the 2 dimensions is independent of spatial stimulus-response compatibility. It is concluded that the results are consistent with a model of interference in which information from pointing gestures and speech is integrated prior to the response selection stage of processing.

Journal
Journal of Experimental Psychology: Human Perception and Performance: Volume 22, Issue 6