3 ms·
10Gbps only? At Google where this type of processing would automatically be distributed, machines had 400Gbps NICs, not to mention other innovations like better
by kccqzy 1y ago
10Gbps only? At Google where this type of processing would automatically be distributed, machines had 400Gbps NICs, not to mention other innovations like better TCP congestion control algorithms. No wonder people are tired of distributed computing.
- basilgohar 1y ago"At Google" is doing all the heavy lifting in your comment here, with all due respect. There is but one Google but remain millions of us who are not "At Google".
- kccqzy 1y agoI’m merely describing the infrastructure that at least partially led to the success of distributed data processing. Also 400Gbps NIC isn’t a Google exclusive. Other clouds and on-premise DCs could buy them from Broadcom or other vendors.
- degamad 1y agoThe infra might have a 400Gbps NIC, but if you're buying a small compute slice on that infra, you don't get all the capability.
- otterley 1y agoYou can get a 600Gbps interface on an Amazon EC2 instance (c8gn.48xlarge), if you’re willing to pay for it.
- nijave 1y agoThey do at AWS, too but op paid for a small VM