5 ms·

Mongo (similar for other NoSql propositions) is most suitable for specific data access patterns. The most obvious one being where you are requesting data and r

Mongo (similar for other NoSql propositions) is most suitable for specific data access patterns. The most obvious one being where you are requesting data and related data based upon a unique business identifier. NoSql DBs mostly make this both trivial and fast. Postgres and other SQL options become relevant where aggregation and reporting become primary considerations.

hardwaresofton 4y ago
Just to explain a little bit why the notion you're pointing to is incorrect -- identity and referential integrity fundamental concepts in the "SQL options" i.e. relational database management systems (RDBMS), based on the relational model[0], rooted in relational algebra[1]. NoSQL Databases arose from a realization that sometimes you don't need all the features of a relational database, for example: - Redis which at the most basic level is a key value cache - MongoDB which stores (denormalized) documents NoSQL Databases like MongoDB are best when: - All data related to a certain entity can be reasonably self contained (i.e. does not require relating to other possibly dynamic pieces of data) - referential integrity (knowing that User.storeId can be treated as just a string) does not need to be maintained - Constraint checking does not need to be performed or can be performed at the application level - Schemas are either wildly variable or do not change at all, or checking them just isn't important. The best example I hear often is a news site or blog -- if your main model is something like an Article that contains the author, content, tags and all data necessary to display one entry (and 99% of the time you get one Article and are not required to request related data that exist in separate collections), then NoSQL makes sense. It's a tired conversation I think people have had repeatedly for a long time, so I won't go into it again (I'm also VERY biased towards RDBMS and in particular Postgres) -- would love to hear from experienced MongoDB proponents though! One case I know Mongo was trusted for very early on was large scale out use cases, and after WiredTiger their execution engine improved immensely as well. I assume it's still great for that, where scale out is often quite lacking in RDBMS or not in the core experience. [0]: https://en.wikipedia.org/wiki/Relational_database#Relational_model https://en.wikipedia.org/wiki/Relational_database#Relational... [1]: https://en.wikipedia.org/wiki/Relational_algebra https://en.wikipedia.org/wiki/Relational_algebra
- ammo1662 4y ago
  The key is that, what kind of ACID properties you need in your business. RDBMS puts a lot of effort to support a wide range of ACID properties. However which also make it very difficult to be used as cluster. So if your bussiness data is too large to be hold by a single instance of database, you will need a database cluster. And maybe someday, you want to get better performance, then you change your schema to remove some data constraints. Like removing FK, use application logic instead of storage procedure, etc. That's the reason why we need NoSql database. If OLTP is not the key part of your business, and it is expected to store a large amount of data in future. Then it would be better to carefully design your data schema so you can use NoSql database instead of a traditional RDBMS.
  - TylerE 4y ago
    I don’t find the schema argument compelling at all. Postgres JSON columns are highly performant and queryable.
    - ammo1662 4y ago
      Not the JSON schema of one object, but the "data schema" of the whole project. E.g. use nested document instead of FK to store 1 to 1 relationship. So you can take advantages of single document atomicity. Use array to store 1 to many relationship instead of an additional mapping table.
  - hardwaresofton 4y ago
    > The key is that, what kind of ACID properties you need in your business. > RDBMS puts a lot of effort to support a wide range of ACID properties. However which also make it very difficult to be used as cluster. Note that while common, ACID is actually not a requirement for RDBMSes -- there are NoSQL datastores that provide acid guarantees, like FoundationDB[0]. > So if your bussiness data is too large to be hold by a single instance of database, you will need a database cluster. And maybe someday, you want to get better performance, then you change your schema to remove some data constraints. Like removing FK, use application logic instead of storage procedure, etc. I agree with the point, but I want to note that the vast majority of apps do not have data too large to be held by a single instance, especially with the eye-watering density of hardware these days. Some proof for my essentially wild conjecture: - Reddit started with just postgres[1] - LetsEncrypt (the reason most of the internet will have TLS in the future if not already) supports over 235MM sites with just one MySQL box[2] Now it's not that you can't mis-use RDBMS (Postgres), or that it's always the right tool for the job, but I just want to note that it's very possible to get very far with application size without scaling out horizontally. Scaling out horizontally & compromising your data model should be the last options you pursue, IMO. Also, that said, Citus for postgres is now fully open source[3], TimescaleDB has been open source and only got open-er[4] (they have a clustering mechanism) so this diminishes the use case for NoSQL going forward. This means that the specific use case for NoSQL is eroding somewhat. > If OLTP is not the key part of your business, and it is expected to store a large amount of data in future. Then it would be better to carefully design your data schema so you can use NoSql database instead of a traditional RDBMS. I'd argue that you should default to OLTP and only deviate when you need the extra power, but we'd probably agree to disagree there :) [EDIT] Highscalability.com has a great writeup on this from 2010 (!) that as I skim through still looks mostly relevant: http://highscalability.com/blog/2010/12/6/what-the-heck-are-you-actually-using-nosql-for.html http://highscalability.com/blog/2010/12/6/what-the-heck-are-... [0]: https://www.foundationdb.org/ https://www.foundationdb.org/ [1]: http://highscalability.com/blog/2013/8/26/reddit-lessons-learned-from-mistakes-made-scaling-to-1-billi.html http://highscalability.com/blog/2013/8/26/reddit-lessons-lea... [2]: https://letsencrypt.org/2021/01/21/next-gen-database-servers.html#openzfs-and-nvme https://letsencrypt.org/2021/01/21/next-gen-database-servers... [3]: https://www.citusdata.com/blog/2022/06/17/citus-11-goes-fully-open-source/ https://www.citusdata.com/blog/2022/06/17/citus-11-goes-full... [4]: https://www.timescale.com https://www.timescale.com

hardwaresofton 4y ago

Just to explain a little bit why the notion you're pointing to is incorrect -- identity and referential integrity fundamental concepts in the "SQL options" i.e. relational database management systems (RDBMS), based on the relational model[0], rooted in relational algebra[1]. NoSQL Databases arose from a realization that sometimes you don't need all the features of a relational database, for example: - Redis which at the most basic level is a key value cache - MongoDB which stores (denormalized) documents NoSQL Databases like MongoDB are best when: - All data related to a certain entity can be reasonably self contained (i.e. does not require relating to other possibly dynamic pieces of data) - referential integrity (knowing that User.storeId can be treated as just a string) does not need to be maintained - Constraint checking does not need to be performed or can be performed at the application level - Schemas are either wildly variable or do not change at all, or checking them just isn't important. The best example I hear often is a news site or blog -- if your main model is something like an Article that contains the author, content, tags and all data necessary to display one entry (and 99% of the time you get one Article and are not required to request related data that exist in separate collections), then NoSQL makes sense. It's a tired conversation I think people have had repeatedly for a long time, so I won't go into it again (I'm also VERY biased towards RDBMS and in particular Postgres) -- would love to hear from experienced MongoDB proponents though! One case I know Mongo was trusted for very early on was large scale out use cases, and after WiredTiger their execution engine improved immensely as well. I assume it's still great for that, where scale out is often quite lacking in RDBMS or not in the core experience. [0]: https://en.wikipedia.org/wiki/Relational_database#Relational_model https://en.wikipedia.org/wiki/Relational_database#Relational... [1]: https://en.wikipedia.org/wiki/Relational_algebra https://en.wikipedia.org/wiki/Relational_algebra

ammo1662 4y ago
The key is that, what kind of ACID properties you need in your business. RDBMS puts a lot of effort to support a wide range of ACID properties. However which also make it very difficult to be used as cluster. So if your bussiness data is too large to be hold by a single instance of database, you will need a database cluster. And maybe someday, you want to get better performance, then you change your schema to remove some data constraints. Like removing FK, use application logic instead of storage procedure, etc. That's the reason why we need NoSql database. If OLTP is not the key part of your business, and it is expected to store a large amount of data in future. Then it would be better to carefully design your data schema so you can use NoSql database instead of a traditional RDBMS.
- TylerE 4y ago
  I don’t find the schema argument compelling at all. Postgres JSON columns are highly performant and queryable.
  - ammo1662 4y ago
    Not the JSON schema of one object, but the "data schema" of the whole project. E.g. use nested document instead of FK to store 1 to 1 relationship. So you can take advantages of single document atomicity. Use array to store 1 to many relationship instead of an additional mapping table.
- hardwaresofton 4y ago
  > The key is that, what kind of ACID properties you need in your business. > RDBMS puts a lot of effort to support a wide range of ACID properties. However which also make it very difficult to be used as cluster. Note that while common, ACID is actually not a requirement for RDBMSes -- there are NoSQL datastores that provide acid guarantees, like FoundationDB[0]. > So if your bussiness data is too large to be hold by a single instance of database, you will need a database cluster. And maybe someday, you want to get better performance, then you change your schema to remove some data constraints. Like removing FK, use application logic instead of storage procedure, etc. I agree with the point, but I want to note that the vast majority of apps do not have data too large to be held by a single instance, especially with the eye-watering density of hardware these days. Some proof for my essentially wild conjecture: - Reddit started with just postgres[1] - LetsEncrypt (the reason most of the internet will have TLS in the future if not already) supports over 235MM sites with just one MySQL box[2] Now it's not that you can't mis-use RDBMS (Postgres), or that it's always the right tool for the job, but I just want to note that it's very possible to get very far with application size without scaling out horizontally. Scaling out horizontally & compromising your data model should be the last options you pursue, IMO. Also, that said, Citus for postgres is now fully open source[3], TimescaleDB has been open source and only got open-er[4] (they have a clustering mechanism) so this diminishes the use case for NoSQL going forward. This means that the specific use case for NoSQL is eroding somewhat. > If OLTP is not the key part of your business, and it is expected to store a large amount of data in future. Then it would be better to carefully design your data schema so you can use NoSql database instead of a traditional RDBMS. I'd argue that you should default to OLTP and only deviate when you need the extra power, but we'd probably agree to disagree there :) [EDIT] Highscalability.com has a great writeup on this from 2010 (!) that as I skim through still looks mostly relevant: http://highscalability.com/blog/2010/12/6/what-the-heck-are-you-actually-using-nosql-for.html http://highscalability.com/blog/2010/12/6/what-the-heck-are-... [0]: https://www.foundationdb.org/ https://www.foundationdb.org/ [1]: http://highscalability.com/blog/2013/8/26/reddit-lessons-learned-from-mistakes-made-scaling-to-1-billi.html http://highscalability.com/blog/2013/8/26/reddit-lessons-lea... [2]: https://letsencrypt.org/2021/01/21/next-gen-database-servers.html#openzfs-and-nvme https://letsencrypt.org/2021/01/21/next-gen-database-servers... [3]: https://www.citusdata.com/blog/2022/06/17/citus-11-goes-fully-open-source/ https://www.citusdata.com/blog/2022/06/17/citus-11-goes-full... [4]: https://www.timescale.com https://www.timescale.com