Dissociating the Neural Correlates of Consciousness and Task Relevance in Face Perception Using Simultaneous EEG-fMRI.

Conscious visual perception of faces is linked to early processing in sensory brain regions, especially the fusiform gyrus, rather than requiring later widespread frontoparietal network activity. Using simultaneous EEG-fMRI and an inattentional blindness paradigm with three identical phases, participants either spontaneously noticed or remained blind to faces during a distractor task. Bayesian analysis showed conscious face perception most strongly activated the fusiform gyrus (fMRI) and produced the N170 and visual awareness negativity (EEG), with smaller effects in occipital and prefrontal cortex. In contrast, task-relevant face processing activated extensive occipitotemporal, frontoparietal, and attentional networks and elicited a pronounced P3b component, suggesting strong frontoparietal activity and the P3b reflect task-related processes rather than consciousness itself.

Study at a glance

Abstract

Current theories of visual consciousness disagree about whether it emerges during early stages of processing in sensory brain regions or later when a widespread frontoparietal network becomes involved. Moreover, disentangling conscious perception from task-related postperceptual processes (e.g., report) and integrating results across different neuroscientific methods remain ongoing challenges. The present study addressed these problems using simultaneous EEG-fMRI and a specific inattentional blindness paradigm with three physically identical phases in female and male human participants. In phase 1, participants performed a distractor task during which line drawings of faces and control stimuli were presented centrally. While some participants spontaneously noticed the faces in phase 1, others remained inattentionally blind. In phase 2, all participants were made aware of the task-irrelevant faces but continued the distractor task. In phase 3, the faces became task-relevant. Bayesian analysis of brain responses demonstrated that conscious face perception was most strongly associated with activation in fusiform gyrus (fMRI) as well as the N170 and visual awareness negativity (EEG). Smaller awareness effects were revealed in the occipital and prefrontal cortex (fMRI). Task-relevant face processing, on the other hand, led to strong, extensive activation of occipitotemporal, frontoparietal, and attentional networks (fMRI). In EEG, it enhanced early negativities and elicited a pronounced P3b component. Overall, we provide evidence that conscious visual perception is linked with early processing in stimulus-specific sensory brain areas but may additionally involve prefrontal cortex. In contrast, the strong activation of widespread brain networks and the P3b are more likely associated with task-related processes.SIGNIFICANCE STATEMENT How does our brain generate visual consciousness-the subjective experience of what it is like to see, for example, a face? To date, it is hotly debated whether it emerges early in sensory brain regions or later when a widespread frontoparietal network is activated. Here, we use simultaneous fMRI and EEG for high spatial and temporal resolution and demonstrate that conscious face perception is predominantly linked to early and occipitotemporal processes, but also prefrontal activity. Task-related processes (e.g., decision-making), on the other hand, elicit brain-wide activations including late and strong frontoparietal activity. These findings challenge numerous previous studies and highlight the importance of investigating the neural correlates of consciousness in the absence of task relevance.