We demonstrate that scaling up language models greatly improves task-agnostic, few-shot
performance, sometimes even becoming competitive with prior state-of-the-art fine-tuning …

Text-to-image generation has traditionally focused on finding better modeling assumptions
for training on a fixed dataset. These assumptions might involve complex architectures, …

Contrastive models like CLIP have been shown to learn robust representations of images that
capture both semantics and style. To leverage these representations for image generation, …

Memory T cells induced by previous pathogens can shape susceptibility to, and the clinical
severity of, subsequent infections 1 . Little is known about the presence in humans of pre-…

Diffusion models have recently been shown to generate high-quality synthetic images,
especially when paired with a guidance technique to trade off diversity for fidelity. We explore …

Previous research has shown that trait concepts and stereotypes become active automatically
in the presence of relevant behavior or stereotyped-group features. Through the use of the …

We introduce Codex, a GPT language model fine-tuned on publicly available code from
GitHub, and study its Python code-writing capabilities. A distinct production version of Codex …

Inspired by progress in unsupervised representation learning for natural language, we
examine whether similar models can learn useful representations for images. We train a …

A robust serological test to detect neutralizing antibodies to SARS-CoV-2 is urgently needed
to determine not only the infection rate, herd immunity and predicted humoral protection, but …

State-of-the-art language models can match human performance on many tasks, but they still
struggle to robustly perform multi-step mathematical reasoning. To diagnose the failures of …