in my opinion, the Phi approach to training language models is just wrong • i'm not convinced that training on less (albeit "higher-quality") data is better than training on as much data as possible
• i'm not convinced that training on synthetic data ever works better than
Phi Training Approach Criticism: Quality Data vs Quantity Debate
By
–