7 ms·
I would be surprised if this is the case. Neural scaling laws are well known and are used by all big industry players to extrapolate experiments.
by jwuphysics 3y ago
I would be surprised if this is the case. Neural scaling laws are well known and are used by all big industry players to extrapolate experiments.
- dmarchand90 3y agoAre they really "laws" my impression is its all just a bunch of empirical trends. We cannot know truly how these parameters interact at large scale and also how they interact with each other. Is it really the case that openai has data that Google doesn't?