I'd guess pretty poorly. but you really don't need that much GPU memory to store a fairly large corpus. all you need is the bag-of-words information for each document; that's the "embedding". eventually you will run out though, and I don't have any hierarchical logic built in.