3 ms·
Great, staple a few ML accelerators to your NIC. Nvidia sells them! You could build an entire supercomputer style setup 100% optimized for Twitter data movement
by nimish 4y ago
Great, staple a few ML accelerators to your NIC. Nvidia sells them! You could build an entire supercomputer style setup 100% optimized for Twitter data movement and computation with COTS hardware IMO.
I strongly doubt that entire datacenters need to be used if and only if Twitter obsessively optimized for hardware usage efficiency over everything else. In reality they don't and make some pretty big compromises to actually get stuff built. Hardware is cheap, people are not.
- threeseed 4y agoa) No one has said that Twitter doesn't use ML accelerators. b) No one has said Twitter operates entire data centres. c) You need more than just NICs and ML accelerators to built a Twitter timeline. You need to rank the content, determine appropriate ads and combine them together. You can't do that in your network card.
- pg314 4y ago> No one has said Twitter operates entire data centres. They do though. 3 in the US alone (https://www.datacenterdynamics.com/en/news/report-elon-musk-considers-shutting-twitters-sacramento-data-center-leaving-just-two/ https://www.datacenterdynamics.com/en/news/report-elon-musk-...).
- nimish 4y agoGood news, Nvidia will now sell you a GPU+NIC+CPU with competitive performance: https://developer.nvidia.com/blog/accelerating-data-center-ai-with-the-nvidia-converged-accelerator-developer-kit/ https://developer.nvidia.com/blog/accelerating-data-center-a... Twitter operates a handful of datacenters because their scale is such that it makes sense.