3 ms·

The Internet is usually not presented to you in real-time in 3rd normalized form. There are times when you can control the data sources, but many times you will

The Internet is usually not presented to you in real-time in 3rd normalized form. There are times when you can control the data sources, but many times you will be presented with data in real time, and you cannot spend the time to normalize everything. A lot depends on the data you have, and the data you anticipate. If you have well-controlled data sources, sure, 3rd normalized form and tables with JOINs. But sometimes you have to deal with the data you're handed. Denormalized and only, at best, semi-structured. Then it's time for NoSQL. i.e., choose the right tool for the data you have and the queries you need. Don't try to force-fit the data to a tool just because you're used to it. Analogy: use a hammer for a nail, and a screwdriver for screws.

Aeolun 5y ago
To be fair, most data is relational.
- PeterCorless 5y ago
  80% of the many zetabtyes of data on the Internet will soon be unstructured. Of the remaining 20% of structured data, only a fraction of it would even qualify as relational. Other structured data could be simple key-value stores, tabular row-and-column stores (single table, no joins), and even graph data models. Like, an Excel spreadsheet is "structured." But it's not a SQL RDBMS. All of which are basically "NoSQL" though you can shove it in an RDBMS if you want. Just as you can slurp an Excel spreadsheet into a RDBMS. Still doesn't make Excel "relational" per se. Can you cite a source that shows the opposite to be true? Source: 80% of global data will be unstructured by 2025 [citing IDC] https://www.analyticsinsight.net/the-future-of-data-revolution-will-be-unstructured-data/ https://www.analyticsinsight.net/the-future-of-data-revoluti... I don't have $4,500 to throw at IDC right now, but their latest in 2021 shows that "structured" data, while still smaller than unstructured data in absolute volumes, is now growing faster than the unstructured data. Basically by tagging it with metadata. (I guess that gives a video "structure?") But this metadata management can be done by use of NoSQL, as is popular within IIoT spaces, or by streaming OOT video providers, not just by throwing all data into an ACID-compliant, locking and blocking transactional RDBMS. https://www.idc.com/getdoc.jsp?containerId=US47998321 https://www.idc.com/getdoc.jsp?containerId=US47998321

Aeolun 5y ago

To be fair, most data is relational.

PeterCorless 5y ago
80% of the many zetabtyes of data on the Internet will soon be unstructured. Of the remaining 20% of structured data, only a fraction of it would even qualify as relational. Other structured data could be simple key-value stores, tabular row-and-column stores (single table, no joins), and even graph data models. Like, an Excel spreadsheet is "structured." But it's not a SQL RDBMS. All of which are basically "NoSQL" though you can shove it in an RDBMS if you want. Just as you can slurp an Excel spreadsheet into a RDBMS. Still doesn't make Excel "relational" per se. Can you cite a source that shows the opposite to be true? Source: 80% of global data will be unstructured by 2025 [citing IDC] https://www.analyticsinsight.net/the-future-of-data-revolution-will-be-unstructured-data/ https://www.analyticsinsight.net/the-future-of-data-revoluti... I don't have $4,500 to throw at IDC right now, but their latest in 2021 shows that "structured" data, while still smaller than unstructured data in absolute volumes, is now growing faster than the unstructured data. Basically by tagging it with metadata. (I guess that gives a video "structure?") But this metadata management can be done by use of NoSQL, as is popular within IIoT spaces, or by streaming OOT video providers, not just by throwing all data into an ACID-compliant, locking and blocking transactional RDBMS. https://www.idc.com/getdoc.jsp?containerId=US47998321 https://www.idc.com/getdoc.jsp?containerId=US47998321