3 ms·
A type-writer or a piano is an application specific piece of hardware, yet people can still do an amazing variety of things with them. In the last few decades
by eru 5y ago
A type-writer or a piano is an application specific piece of hardware, yet people can still do an amazing variety of things with them.
In the last few decades we got really lucky that general purpose CPUs kept getting faster and faster. So many of us could get away with ignoring application specific computer hardware.
Btw, as far as I can tell, TPUs are really just a variant of GPUs with an emphasis on lower precision?
Have a look also at the kind of special purpose hardware people make to mine crypto-currencies. I think the challenge for your teenage hacker is not so much to make them do interesting things, but to design them? (Assuming the tools and simulators become cheap enough?) FPGAs seem like they are cheap enough for a teenager?
- rrss 5y ago> Btw, as far as I can tell, TPUs are really just a variant of GPUs with an emphasis on lower precision? GPUs and TPUs have substantially different architectures, it’s not accurate to consider a TPU an a variant of a GPU. See https://dl.acm.org/doi/pdf/10.1145/3360307 https://dl.acm.org/doi/pdf/10.1145/3360307, particularly section “Contrasting GPU and TPU Architectures” looking only at the matrix multiply units (and ignoring the hardware multithreading in GPUs that was deliberately not part of the TPU architecture): TPUv3: 2 cores, 2 128x128 matrix multiply units per core V100: 80 cores, 8 4x4 matrix multiply units per core
- eru 5y agoThanks for the background information!