3 ms·
Hi! I'm the author. You're right! The context that I was talking about was actually in the GIS space! Depending on what you're trying to do, it's not uncommon
by v2thegreat 2y ago
Hi! I'm the author.
You're right! The context that I was talking about was actually in the GIS space! Depending on what you're trying to do, it's not uncommon to have a single dataset that's 50TB large (think: 100-500m resolution global raster with daily data for 30 years)
And that's not even considering any memory overhead when performing operations on top of that data.
That type of stuff wouldn't fit into Postgres (we tried once, a long time ago), and usually, you might be trying to use multiple datasets simultaneously, so that data adds up pretty quickly!
It's my first post (and writing) ever, so I have room for improvement. Thanks for taking the time to read!