With the recent scaling law papers that have come out you can evidently predict with pretty high accuracy how good your model will be by plotting out the scalin

With the recent scaling law papers that have come out you can evidently predict with pretty high accuracy how good your model will be by plotting out the scaling curves. So performance @ X Flops and Y tokens can be reasonably well known ahead of time.