AI Dynamics

Global AI News Aggregator

About

Vision VAE as Ultimate Tokenizer: Unicode Efficiency

Very cool work direction but also fair question.
I wonder if ultimately is a little vision patch VAE the ultimate "tokenizer"? Unicode + UTF-8 is just too high description length.

→ View original post on X — @karpathy