4 ms·
So are they talking about software or hardware? They talk about LHC, but the innovation there was using a different file system: GPFS (http://iopscience.iop.or
by KaiserPro 11y ago
So are they talking about software or hardware?
They talk about LHC, but the innovation there was using a different file system: GPFS (http://iopscience.iop.org/1742-6596/219/7/072030 http://iopscience.iop.org/1742-6596/219/7/072030) which meant that data is sharded, managed by age and transparently cached intelligently
Are they instead talking about using replacing TCP with something more designed for bulk data transfer?
Or are they talking about lighting up fibre with different transmitter pairs? (think dwdm x 10 http://www.webopedia.com/TERM/D/DWDM.html http://www.webopedia.com/TERM/D/DWDM.html)
for 5 million, I'd assume its software, if that the case, its pretty much just copy and paste what everyone else has been doing:
http://filecatalyst.com/ http://filecatalyst.com/
http://asperasoft.com/ http://asperasoft.com/
for opensource there is:
http://uftp-multicast.sourceforge.net/ http://uftp-multicast.sourceforge.net/
http://tsunami-udp.sourceforge.net/ http://tsunami-udp.sourceforge.net/
https://github.com/facebook/wdt https://github.com/facebook/wdt
And a myriad of others. Multi stream TCP is fairly simple as the application doesn't have to deal with rate limiting or error correction.
- M2Ys4U 11y ago> So are they talking about software or hardware? Well, if you read the very first sentence of the article: A series of ultra-high-speed fiber-optic cables will weave a cluster of West Coast university laboratories and supercomputer centers into a network called the Pacific Research Platform as part of a five-year $5 million dollar grant from the National Science Foundation.
- jblow 11y agoThat sentence is not informative. The backbone of the regular internet is fiber optics as well (usually).