5The authors and their affiliated institutions are not in any way affiliated with the creation of the OpenWebText dataset.