AI Dynamics

Global AI News Aggregator

Internet Text Data Loss: Missing Draft Revisions for GPT Training

Yep! The interesting part is that most of the text on the internet is the "final" text, after you've revised it for a bit. All of that "latent structure" of your drafts, edits, going back and forth etc. is sadly lost. This would make for ideal data for GPTs so they can learn the

→ View original post on X — @karpathy,

Commentaires

Leave a Reply

Your email address will not be published. Required fields are marked *