For science I also added:
– Choice of Embedding: simple tfidf bigrams or the OpenAI API embeddings ada-002 (ada should work better (?), tfidf is much much simpler)
– Choice of Ranker: kNN (much faster/simpler) or SVM
Default that seems to be both good & fast is ada+knn

→ View original post on X — @karpathy,