Yep! The interesting part is that most of the text on the internet is the "final" text, after you've revised it for a bit. All of that "latent structure" of your drafts, edits, going back and forth etc. is sadly lost. This would make for ideal data for GPTs so they can learn the
Internet Text Data Loss: Missing Draft Revisions for GPT Training
By
–
Leave a Reply