3 ms·

chinchilla only says that it would be more computationally efficient to have more data than to make the model larger, not that making the model larger wouldn't

by make3 4y ago

chinchilla only says that it would be more computationally efficient to have more data than to make the model larger, not that making the model larger wouldn't still benefit in performance gain

naasking 4y ago
Sure, but why would you spend on compute that you don't need?
- make3 4y ago
  if there is not enough data then all we can do is increase model size, which supports my original point