Several studies have reported that stress impairs memory retrieval, even though findings are not unequivocal. Moreover, memory for socially relevant information was not previously investigated. The present study aimed to test the effects of stress on the retrieval of social memory (e.g., memory concerning names, birthdays, or biographies). In a randomized cross-over experiment, the cognitive performance of 29 subjects (15 women) was tested twice. Social memory was tested in a stress session, in which participants were exposed to a brief standardized psychosocial laboratory stressor between encoding and retrieval. Performance was compared with a stress-free control session. Stress exposure caused an increase in cortisol concentrations and changes in several mood measures. Social memory retrieval was reduced in the stress compared with the control session. An association between the cortisol stress response and poorer retrieval was significant in responders, that is, those participants displaying a cortisol rise after stress onset. Thus, similar to other forms of declarative memory, the retrieval of declarative memory for socially relevant information learned from biographical notes is impaired after acute stress exposure. This effect is linked to the stress-induced cortisol increase.