4 ms·

For some reason, wrapping my mind around this is like trying to fathom the Grand Canyon or the scale of the universe.

• dalke 13y ago
  You and me both. It's made even worse when you learn that the first-level trigger removes 90% of the input stream before passing it to 2,000 computers, which in turn select only 0.2% of that data for storage and further analysis. https://lhcb-public.web.cern.ch/lhcb-public/en/Data%20Collection/Triggers-en.html https://lhcb-public.web.cern.ch/lhcb-public/en/Data%20Collec...
  • toomuchtodo 13y ago
    Fermilab in Batavia takes data from CERN over a 40Gb/s optical link (CMS Tier1, CERN CMS is Tier0); when I was there several years ago, we were staging the data to ~500TB of spinning disk in Nexans and cold storage were 2-3 Storagetek tape libraries the size of school busses. Computing and particle physics is where awesome meet.
    • dekhn 13y ago
      CERN and its associated teams (CMS and ATLAS) are awesome. They are the only outfit outside of Google that seems to be handling data management and computing properly.
      • toomuchtodo 13y ago
        Not to disappoint you, but I could tell you horror stories about my time working on the CMS team at Fermilab. Horrible, horrible stories. I hope the CMS and ATLAS teams onsite at CERN were much better.
        • ohashi 13y ago
          I would be curious to hear some of these stories.
          • toomuchtodo 13y ago
            I'll have to put a blog post together about it. Extremely poor planning, no accountability, a boss who was verbally and emotionally abusive to a co-worker (the reason I quit after only a year there and went back to the private sector).
      • cshimmin 13y ago
        ATLAS guy here. I agree with @toomuchtodo, we're stuck in the stone age. It's basically just batch processing and lots of copying data around for no reason.
        • dekhn 13y ago
          You could say the same thing about google's backend (batch processing and copying data), but it seems to be working for them as well.