3 ms·
You and me both. It's made even worse when you learn that the first-level trigger removes 90% of the input stream before passing it to 2,000 computers, which in
by dalke 13y ago
You and me both. It's made even worse when you learn that the first-level trigger removes 90% of the input stream before passing it to 2,000 computers, which in turn select only 0.2% of that data for storage and further analysis.
https://lhcb-public.web.cern.ch/lhcb-public/en/Data%20Collection/Triggers-en.html https://lhcb-public.web.cern.ch/lhcb-public/en/Data%20Collec...
- toomuchtodo 13y agoFermilab in Batavia takes data from CERN over a 40Gb/s optical link (CMS Tier1, CERN CMS is Tier0); when I was there several years ago, we were staging the data to ~500TB of spinning disk in Nexans and cold storage were 2-3 Storagetek tape libraries the size of school busses. Computing and particle physics is where awesome meet.
- dekhn 13y agoCERN and its associated teams (CMS and ATLAS) are awesome. They are the only outfit outside of Google that seems to be handling data management and computing properly.
- toomuchtodo 13y agoNot to disappoint you, but I could tell you horror stories about my time working on the CMS team at Fermilab. Horrible, horrible stories. I hope the CMS and ATLAS teams onsite at CERN were much better.
- ohashi 13y agoI would be curious to hear some of these stories.
- toomuchtodo 13y agoI'll have to put a blog post together about it. Extremely poor planning, no accountability, a boss who was verbally and emotionally abusive to a co-worker (the reason I quit after only a year there and went back to the private sector).
- cshimmin 13y agoATLAS guy here. I agree with @toomuchtodo, we're stuck in the stone age. It's basically just batch processing and lots of copying data around for no reason.
- dekhn 13y agoYou could say the same thing about google's backend (batch processing and copying data), but it seems to be working for them as well.