3 ms·
Actually MongoDB is quite popular in the analytics space. It has a unique trick with Spark/Hadoop where its data gets represented as a single wide table. This a
by threeseed 8y ago
Actually MongoDB is quite popular in the analytics space. It has a unique trick with Spark/Hadoop where its data gets represented as a single wide table. This allows you to use it as an analytical/ML feature store which is not possible with anything other than Cassandra.
Also not sure where you get the idea dataframes are unique to SQL databases because that's completely wrong. HBase and Cassandra were even the original big data databases and they aren't relational. And Spark can manifest almost any database as a dataframe.
- nevi-me 8y agoI've had lots of fun using Mongo with Spark, I have found it pleasant, though most Spark libraries are good to use, including the JDBC ones. I haven't had much luck with the kind of viz where you don't first do ETL from Mongo to some tabular format.
- wenc 8y ago> not sure where you get the idea dataframes are unique to SQL databases I'm not sure I said this. > HBase and Cassandra were even the original big data databases and they aren't relational. They also had trouble doing joins and many other query operations which are common in analytics. Presto addresses this somewhat. > And Spark can manifest almost any database as a dataframe. Which entails a translation layer from whatever non-tabular form that data was (e.g. JSON) into a dataframe-like structure, rather keeping it in its native form, which reinforces my point. You still need to somehow transform data into tabular form. (ETL is just a batch way of doing this transformation; you can have live transformations of course, with accompanying overheads) BI tools also generally require data to be in tabular form, which entails the use of a translation layer. The Mongo BI connector is one such translator. > Actually MongoDB is quite popular in the analytics space. I work in this space, interact regularly with vendors, and monitor the space actively for strategic developments. This does not track with my observations.