2Code and pretrained checkpoints are available at https://github.com/google-research/simclr.