Audio-visual synchrony and feature-selective attention co-amplify early visual processing

Citation

Keitel C & Müller MM (2016) Audio-visual synchrony and feature-selective attention co-amplify early visual processing. Experimental Brain Research, 234 (5), pp. 1221-1231. https://doi.org/10.1007/s00221-015-4392-8

Abstract
Our brain relies on neural mechanisms of selective attention and converging sensory processing to efficiently cope with rich and unceasing multisensory inputs. One prominent assumption holds that audio-visual synchrony can act as a strong attractor for spatial attention. Here, we tested for a similar effect of audio-visual synchrony on feature-selective attention. We presented two superimposed Gabor patches that differed in colour and orientation. On each trial, participants were cued to selectively attend to one of the two patches. Over time, spatial frequencies of both patches varied sinusoidally at distinct rates (3.14 and 3.63 Hz), giving rise to pulse-like percepts. A simultaneously presented pure tone carried a frequency modulation at the pulse rate of one of the two visual stimuli to introduce audio-visual synchrony. Pulsed stimulation elicited distinct time-locked oscillatory electrophysiological brain responses. These steady-state responses were quantified in the spectral domain to examine individual stimulus processing under conditions of synchronous versus asynchronous tone presentation and when respective stimuli were attended versus unattended. We found that both, attending to the colour of a stimulus and its synchrony with the tone, enhanced its processing. Moreover, both gain effects combined linearly for attended in-sync stimuli. Our results suggest that audio-visual synchrony can attract attention to specific stimulus features when stimuli overlap in space.

Keywords
Feature-based attention; selective attention; multisensory integration; audio-visual synchrony; brain oscillations; neural rhythms; steady-state visual evoked potentials (SSVEP); EEG; Brain-computer interface (BCI)

Journal
Experimental Brain Research: Volume 234, Issue 5

• Keitel Müller-EBR-2016