3 ms·

Thanks for your comment! Do you feel that, in the medium term, as ever larger datasets are generated the overall computing power will be unable to catch up?

• greglindahl 11y ago
  Data gets bigger because instruments have bigger/better sensors (the biggest of which are built like computers) and there is more storage and bandwidth. So it basically advances in lockstep with computing power. There's a lot of hand-waving and details, but that's the overall answer.
• cyphar 11y ago
  To be quite frank, the limiting factor is not computing power, it's code written by physicists. I'm a software developer by trade, and it's sometimes painful to see the type of code my supervisors write. I get the feeling that "our simulation takes half an hour" is acceptable and they won't try to optimise it unless they're near a deadline. Obviously, that's not deriding them, they have much better things to do than to micro-optimise their code. But in general I prefer writing all of my analysis scripts from scratch after discussing what methods they used. :P