4 ms·
That's today... think of the future My first computer had 512KB RAM and 20MB was an expensive hard drive. 64GB Macbooks are currently an expensive 'Pro' novel
by anentropic 4y ago
That's today... think of the future
My first computer had 512KB RAM and 20MB was an expensive hard drive.
64GB Macbooks are currently an expensive 'Pro' novelty, they will be the vanilla of tomorrow
> i don't see the ml accelerators/gpu in current models being capable enough to make the most of the memory available to it
that's exactly my point (and apparently today's Neural Engine can't even take advantage of all the unified memory available)
until LLaMA there was no reason to have more than this, they probably imagined it would just run a bit of face-detection and speech-to-text on the side
but if they got serious and beefed it up it could be the next wave of computing IMHO