Less protocol-complaint but likely also dumber. You see a similar phenomenon if you ask it to speak in l33t5p34k, or with hyphens between all letters, or especially with Zalgo text. Base64 is interesting though because it probably sees a *lot* of translation pairs in pre-train.