4 ms·
Information density will increase in models just as spatial density increased for hardware.
by yayitswei 3y ago
Information density will increase in models just as spatial density increased for hardware.
- whimsicalism 3y agoSaying that information density will increase is very different from saying model sizes will decrease of a similar order of magnitude. Regardless, this isn't the trend we've seen with software RAM usage - information density is only decreasing as hardware becomes more abundant and comparatively less engineering effort goes into fitting everything into as small a portion as possible.