3 ms·
~ 100TB an hour of data. I’m guessing it doesn’t compress well. Do they write that to disk or filter it in memory and only pass on a subset?
by breck 8y ago
~ 100TB an hour of data.
I’m guessing it doesn’t compress well. Do they write that to disk or filter it in memory and only pass on a subset?
- ggggtez 8y agoIf it was compressible, that would mean there was a repeating pattern. The whole point is that the data is extremely noisy, so finding a pattern is difficult.
- daodedickinson 8y agoI imagine a lot of sensors are detecting the same silence or non-zero EM signal most of the time (when adjusted to be as-if they were pointed in the same direction, anyway) and differences are the rarity.
- iamgopal 8y agoSo finding SETI is all about finding compressible data ?
- andbberger 8y agoActually, yes. There's a deep connection between the compressibility and predictability of things. But we're not good at learning the complex distributions needed for these sorts of things - there's a long standing competition for natural language compression, the idea being if you can do that perfectly you basically have human level semantic understanding.