3 ms·
Scale 'out' has been around forever. The eminence of AI is more 'volumetric' than 'out' Out scales "up and out like a hill or a lift" - volumetric is spheric
by samstave 3y ago
Scale 'out' has been around forever.
The eminence of AI is more 'volumetric' than 'out'
Out scales "up and out like a hill or a lift"
- volumetric is spherical - it presses into the future AND the past (it already has been harvesting history, but created a fire-hosed spigot-interface for the future as well) -- and draws it into its center for eval...
They are different.
Always on the positive expressions of XYZ axis - but had ignored the negative of each, where AGI will go in all dimensions...
- smoldesu 3y agoI don't think this aligns with the Chinchilla scaling law. There is indeed a point at which you can oversaturate a model with data, as well as such thing as not giving it enough. Compute is the constraining factor, and it scales more-or-less linearly in both directions.
- samstave 3y agoThank you - what is your reco for best info on that law?c