AI Dynamics

Global AI News Aggregator

GPU Memory Requirements for Document Embedding Storage

I'd guess pretty poorly. but you really don't need that much GPU memory to store a fairly large corpus. all you need is the bag-of-words information for each document; that's the "embedding". eventually you will run out though, and I don't have any hierarchical logic built in.

→ View original post on X — @jxmnop,

Commentaires

Leave a Reply

Your email address will not be published. Required fields are marked *