Functional Magnetic Resonance Imaging of Human Visual Cortex during Face Matching: A Comparison with Positron Emission Tomography

doi:10.1006/nimg.1996.0025

NeuroImage

Volume 4, Issue 1, August 1996, Pages 1-15

https://doi.org/10.1006/nimg.1996.0025 Get rights and content

Abstract

Cortical areas associated with the perception of faces were identified using functional magnetic resonance imaging (fMRI). T2*-weighted gradient echo, echo-planar MR images were obtained using a modified 1.5-T GE Signa MRI. In all nine subjects studied, performance of a face-matching task was associated with a region of significantly increased MR signal in the ventral occipitotemporal cortex, extending from the inferior occipital sulcus to the lateral occipitotemporal sulcus and fusiform gyrus. Smaller and more variable signal increases were found in dorsolateral occipitoparietal cortex near the intraparietal sulcus. Signal decreases were found in the angular gyrus and posterior cingulate cortex. Single-subject fMRI analyses revealed discrete areas of activation with well-defined borders. Group analyses of spatially smoothed fMRI data produced results that replicated most aspects of previous studies of face processing using positron emission tomography (PET). These results show that PET and fMRI identify functional areas with similar anatomical locations. In addition, fMRI reveals interindividual variation in the anatomical location of higher-level processing areas with greater anatomical precision.

References (0)

Cited by (217)

Anatomical and neurophysiological basis of face recognition
2022, Revue Neurologique
Face recognition is a highly developed and efficient human function that involves multiple neural networks. A main pathway links the occipital cortex, where an occipital face area (OFA) has been identified, to a fusiform face area (FFA) in the fusiform gyrus, which plays a critical role in face recognition. This core pathway deals with invariant aspects of the face. Another pathway, including the superior temporal sulcus, is involved in the perception of more changeable aspects of the face such as gaze orientation, face expression and lip movements. It has been defined by some authors as a “third pathway of visual recognition”, i.e. a lateral pathway in addition to the “what” and “where” pathways. It deals with sociocognitive aspects of face perception. Many other accessory functional systems are connected to the core system of visual recognition to act in concert with it: the intraparietal sulcus (for the management of spatial attention), the primary auditory cortex (prelexical perception of speech), the amygdala, the insula and the limbic system (perception of emotions), the anterior temporal pole (access to the identity of the individual, his name, biographical information), etc. Functional brain imaging has made remarkable progress in the understanding of face perception, which in the early years was limited to the description of single cases of brain-damaged patients. This progress has made it possible to better analyse the many face recognition disorders, sometimes subtle, other times confusing, observed in human pathology.
Effect of face-related task on rapid individual face discrimination
2019, Neuropsychologia
Citation Excerpt :
Similarly, Jackson and Raymond (2006) reported that the recognition of unfamiliar faces was susceptible to temporal attention effects (attentional blink). At the neural level, face-selective responses in the middle fusiform gyrus of the ventral ocipito-temporal cortex are stronger when participants pay attention to the face stimuli (while ignoring superimposed non-face objects), or perform a face instead of a house matching/recognition task (Baldauf and Desimone, 2014; Clark et al., 1996; Furey et al., 2006; Haxby et al., 1994; O'Craven et al., 1999; Wojciulik et al., 1998; Yi et al., 2006). The time-course of these effects of attention remain controversial however, with some studies finding a modulation of face processing only after 200 ms of stimulus onset (Engell and McCarthy, 2010; Lueschow et al., 2004), while other studies showed that the early stages of face processing indexed by N170 was strongly modulated by selective attention (Mohamed et al., 2009).
Human adults can typically visually discriminate the faces of unfamiliar individuals accurately, rapidly, and automatically, i.e. even without the explicit intention to do so. Recent studies have used fast periodic visual stimulation (FPVS) coupled with electroencephalography (EEG) to measure this process with objectivity and high sensitivity during simple non-face related tasks (Liu-Shuang et al., 2014). Here we consider to what extent fast individual face discrimination measured in the human brain with this approach is modulated by a direct face-related task. We recorded 128-channel EEG while participants viewed 70s sequences of a random female face identity (A) repeating at 6 Hz. Female faces of different identities (B, C…), interleaved regularly every 7th image (AAAAAABAAAAAAC…) led to significant periodic responses at 0.857 Hz (i.e., 6 Hz/7) and its harmonics, thereby indexing individual face discrimination. Participants performed two tasks: (1) an orthogonal Fixation task, monitoring random colour changes of the central fixation cross, and (2) a Face task, detecting male faces randomly replacing a female face. While the implicit Fixation task elicited robust individual face discrimination responses peaking over the (right) occipito-temporal region, the Face task led to significantly greater overall response amplitude (∼100% increase). However, this attentional boost strongly reduced response specificity by disproportionately recruiting prefrontal and central parietal regions, thereby blurring the occipito-temporal topography typical of specialized high-level face processing. The individual face discrimination response over face-selective occipito-temporal cortex was modulated by the face-sex task starting from 180 ms onset, followed by activations over prefrontal and central parietal region from 200 ms to 450 ms, respectively. Overall, these findings show that even a robust automatic individual face discrimination response can be further enhanced when explicitly searching for face-related information, albeit with a decrease in response specificity.
Emotional context restores cortical prediction error responses in schizophrenia
2018, Schizophrenia Research
Citation Excerpt :
In prior research, the differentiation between neutral and emotional deviants is related different topographical locations on the cortex. In an earlier study, neuronal source localization of emotional deviants revealed activation of bilateral temporal cortex, occipital areas, posterior cingulate, fusiform, parahippocampal gyri and right insula (Vogel et al., 2015), which is accordance with earlier research on expression-related MMN (Kimura et al., 2011; Li et al., 2012) and early studies on face processing (e.g. Bentin et al., 1996; Clark et al., 1996; Kanwisher et al., 1997). In contrast to this widespread activation during pure emotional processing, neutral deviants have been shown to evoke confined activations in the left middle temporal gyrus and the superior temporal gyrus (Vogel et al., 2015), which is in line with studies on face processing (Haxby et al., 2000) and studies employing a visual oddball paradigm (review: Pazo-Alvarez et al., 2003).
The mismatch negativity (MMN) deficit in schizophrenia is a consistently replicated finding and is considered a potential biomarker. From the cognitive neuroscience perspective, MMN represents a cortical correlate of the prediction error, a fundamental computational operator that may be at the core of various cognitive and clinical deficits observed in schizophrenia. The impact of emotion on cognitive processes in schizophrenia is insufficiently understood, and its impact on basic operators of cortical computation is largely unknown. In the visual domain, the facial expression mismatch negativity (EMMN) offers an opportunity to investigate basic computational operators in purely cognitive and in emotional contexts. In this study, we asked whether emotional context enhances cortical prediction error responses in patients with schizophrenia, as is the case in normal subjects. Therefore, seventeen patients with schizophrenia and eighteen controls completed a visual sequence oddball task, which allows for directly comparing MMN components evoked by deviants with high, intermediate and low emotional engagement. Interestingly, patients with schizophrenia showed pronounced deficits in response to neutral stimuli, but almost normal responses to emotional stimuli. The dissociation between impaired MMN and normal EMMN suggests that emotional context not only enhances, but restores cortical prediction error responses in patients with schizophrenia to near-normal levels. Our results show that emotional processing in schizophrenia is not necessarily defect; more likely, emotional processing heterogeneously impacts on cognition in schizophrenia. In fact, this study suggests that emotional context may even compensate for cognitive deficits in schizophrenia that are, in a different sensory domain, discussed as biomarkers.
A method to establish the spatiotemporal evolution of task-related cortical activity from electrocorticographic signals in single trials
2016, Journal of Neuroscience Methods
Progress in neuroscience depends substantially on the ability to establish the detailed spatial and temporal sequence of neuronal population-level activity across large areas of the brain. Because there is substantial inter-trial variability in neuronal activity, traditional techniques that rely on signal averaging obscure where and when neuronal activity occurs. Thus, up to the present, it has been difficult to examine the detailed progression of neuronal activity across large areas of the brain.
Here we describe a method for establishing the spatiotemporal evolution of neuronal population-level activity across large brain regions by determining exactly where and when neural activity occurs during a behavioral task in individual trials. We validate the efficacy of the method, examine the effects of its parameterization, and demonstrate its utility by highlighting two sets of results that could not readily be achieved with traditional methods.
Our results reveal the precise spatiotemporal evolution of neuronal population activity that unfolds during a sensorimotor task in individual trials, and establishes the relationship between neuronal oscillations and the onset of this activity.
The ability to identify the spatiotemporal evolution of neuronal population activity onsets in single trials gives investigators a powerful new tool with which to study large-scale cortical processes.
Neural architecture underlying classification of face perception paradigms
2015, NeuroImage
We present a novel strategy for deriving a classification system of functional neuroimaging paradigms that relies on hierarchical clustering of experiments archived in the BrainMap database. The goal of our proof-of-concept application was to examine the underlying neural architecture of the face perception literature from a meta-analytic perspective, as these studies include a wide range of tasks. Task-based results exhibiting similar activation patterns were grouped as similar, while tasks activating different brain networks were classified as functionally distinct. We identified four sub-classes of face tasks: (1) Visuospatial Attention and Visuomotor Coordination to Faces, (2) Perception and Recognition of Faces, (3) Social Processing and Episodic Recall of Faces, and (4) Face Naming and Lexical Retrieval. Interpretation of these sub-classes supports an extension of a well-known model of face perception to include a core system for visual analysis and extended systems for personal information, emotion, and salience processing. Overall, these results demonstrate that a large-scale data mining approach can inform the evolution of theoretical cognitive models by probing the range of behavioral manipulations across experimental tasks.
Functional mapping of dynamic happy and fearful facial expressions in young adults with familial risk for psychosis - Oulu Brain and Mind Study
2015, Schizophrenia Research
Citation Excerpt :
During social interaction we cannot avoid facial stimuli that activate several brain regions in a characteristic way. Perception of faces has been associated with activations of the occipital and occipitotemporal areas (Clark et al., 1996; Haxby et al., 1994), inferior frontal cortex (Nakamura et al., 1999), fusiform gyrus (Dolan et al., 1996), superior temporal sulcus (Allison et al., 2000), medial prefrontal cortex (Dolan et al., 1996; Nakamura et al., 1999) and the limbic system (Adolphs et al., 1994; Breiter et al., 1996; Phillips et al., 1997). Deficient emotion processing of others is a common feature in patients with psychotic disorders (Chan et al., 2010; Comparelli et al., 2013; Daros et al., 2014), including in the prodromal phase.
Social interaction requires mirroring to other people's mental state. Psychotic disorders have been connected to social interaction and emotion recognition impairment. We compared the brain activity between young adults with familial risk for psychosis (FR) and matched controls during visual exposure to emotional facial expression. We also investigated the role of the amygdala, the key region for social interaction and emotion recognition.
51 FR and 52 control subjects were drawn from the Northern Finland 1986 Birth Cohort (Oulu Brain and Mind Study). None of the included participants had developed psychosis. The FR group was defined as having a parent with psychotic disorder according to the Finnish Hospital Discharge Register. Participants underwent functional MRI (fMRI) using visual presentation of dynamic happy and fearful facial expressions. FMRI data were processed to produce maps of activation for happy and fearful facial expression, which were then compared between groups. Two spherical regions of interest (ROIs) in the amygdala were set to extract BOLD responses during happy and fearful facial expression. BOLD responses were then compared with subjects' emotion recognition, which was assessed after fMRI. Psychophysiological interaction (PPI) for the left and right amygdala during happy and fearful facial expression was conducted using the amygdala as seed regions.
FR subjects had increased activity in the left premotor cortex and reduced deactivation of medial prefrontal cortex structures during happy facial expression. There were no between-group differences during fearful facial expression. The FR group also showed a statistically significant linear correlation between mean amygdala BOLD response and facial expression recognition. PPI showed that there was a significant negative interaction between the amygdala and the dorsolateral prefrontal cortex (dlPFC) and superior temporal gyrus in FR subjects.
Increased activations by positive valence in FR were in brain regions crucial to emotion recognition and social interaction. Increased activation of the premotor cortex may serve as a compensatory mechanism as FR subjects may have to exert more effort on processing the stimuli, as has been found earlier in schizophrenia. Failure to deactivate PFC structures may imply error in the default mode network. Abnormal PFC function in FR was also suggested by PPI, as the dlPFC showed decreased functional connectivity with the amygdala in the FR group. This may indicate that in FR subjects the amygdala have to take a greater role in emotion recognition and social functioning. This inference was supported by our discovery of statistically significant correlations between the amygdala BOLD response and emotion recognition in the FR group but not in controls.

View all citing articles on Scopus

View full text

Regular ArticleFunctional Magnetic Resonance Imaging of Human Visual Cortex during Face Matching: A Comparison with Positron Emission Tomography

Abstract

Regular Article
Functional Magnetic Resonance Imaging of Human Visual Cortex during Face Matching: A Comparison with Positron Emission Tomography