Nostalgebraist talked over the extreme weirdness of BPEs and how they alter chaotically based on whitespace, capitalization, and context for GPT-2, with a followup publish for GPT-3 on the even weirder encoding of quantities sans commas.