Scaling up the size and training horizon of deep learning models has enabled breakthroughs in computer vision and natural language processing.