16 ms·
I see a lot of mention on various forums about the storage they used (5pb) but am just wondering if anyone know what kind of backend they used to house this? Fr
by morrbo 8y ago
I see a lot of mention on various forums about the storage they used (5pb) but am just wondering if anyone know what kind of backend they used to house this? From what I saw there were too many disks - in the wrong type of enclosure - to be running on a single server, which suggests multiple physical servers. I've seen a prior CERN research paper on gluster and ceph (iirc) and am just wondering if anyone in the know could enlighten me?
- njepa 8y agoSeems like what you are seeing on the image of the drives is part of this: https://www.haystack.mit.edu/tech/vlbi/mark6/index.html https://www.haystack.mit.edu/tech/vlbi/mark6/index.html Found it through this pdf: https://fskbhe1.puk.ac.za/people/mboett/Texas2017/Doeleman.pdf https://fskbhe1.puk.ac.za/people/mboett/Texas2017/Doeleman.p...
- princekolt 8y agoI read yesterday they were using a bunch of servers connected with a 40Gbps network link. I'll try to find the source.
- andrelaszlo 8y agoThe WaPo article also references a few of the interesting issues they had: "Then they spent the two years parsing literal truckloads of data, some of which had to be shipped on hard drives from the South Pole and defrosted outside a supercomputer facility at MIT." https://www.washingtonpost.com/science/2019/04/10/see-black-hole-first-time-images-event-horizon-telescope/ https://www.washingtonpost.com/science/2019/04/10/see-black-... I'd love to read more about this if anyone has an article with more details.