I end with general advice to plot scaling laws for your work. Scaling laws will tell you whether doing more of your thing (on some axis) will continue improving performance or whether it will saturate (i.e., whether it will stand the test of time).

→ View original post on X — @_jasonwei