There are two kinds of people in AI: those who are happily surprised a model would know random facts like these (worth burning compute and parameters), and those who think it's a complete waste of both for a dense core.
Compute Trade-offs: Factual Knowledge vs Dense Core Efficiency
By
–
