6 ms·
If it's 5G boiled down and your production data is likely to be within two magnitudes, why in the world are you not just reading all of it into RAM and operatin
by vidarh 10y ago
If it's 5G boiled down and your production data is likely to be within two magnitudes, why in the world are you not just reading all of it into RAM and operating on it?
- barrkel 10y agoLike I said, if I it was my choice, I'd use MonetDB - that screams. But it has operational deficits, like experimental replication. I'd also look further into MemSQL than is visible on their website. The reason I don't load it into memory and operate on it directly is because it's analytics as a service; I don't particularly want to write a SQL parser and execution engine. We have looked at things like Zeppelin for more interactive data manipulation, using Spark to keep stuff in memory. But building a UI around that is an open-ended rabbit hole.