without bm25_pt you either have to use really slow string-based code (rank-bm25) or run a server (elasticsearch) to do bm25 in python now, it's a pip package, and two lines; i made everything fast using huggingface & pytorch

→ View original post on X — @jxmnop