4 ms·

Sorry but this is a terrible idea. ES is not meant as a durable store. Its designed as an ephemeral abstraction on top of a more durable storage mechanism like

Sorry but this is a terrible idea. ES is not meant as a durable store. Its designed as an ephemeral abstraction on top of a more durable storage mechanism like Postgres or the like. This is just asking for trouble to use it like this.

aprdm 7y ago
How is something meant as a durable store or not? I've worked in companies that had only ES as a database for years and they didn't had complaints. I've seen it working mostly well in these orgs and because of my now experience with it would likely strongly consider it as a database just like mongo and friends with the benefits of having a very large ecosystem (elk, beats etc.) Which can make it a one stop shop for all things in an org
- vikingcaffiene 7y ago
  ES is an eventually consistent data store meaning that it makes no guarantees about data availability when you put stuff in there. That alone should be a deal breaker for you. If you use ES for what it's designed to be and make it a projection of your underlying durable data store, you can do things like rebuild your index or change your schema without fear of data loss. Its a document store, not a database. MongoDB is too but they try to hide it by bolting on all the stuff traditional relational DB's have like ACID and transactions so you wont realize what a poor choice it is as a database when compared to say, Postgres.
  - aprdm 7y ago
    That's not entirely true, it has its guarantees and ways of work is just not the same as more traditional SQL dbs and that's ok for tons of applications.
    - vikingcaffiene 7y ago
      Are you referring to the real time flag? My understanding is that that is per shard and if you try to pull from another shard that hasn't updated its index, you'd get stale data. Maybe you are referring to something else or I am wrong about that? It doesn't change the larger point that using ES as your primary database is not playing to its strengths. You're better served using a transactional data store and building your indexes from that.
  - Thaxll 7y ago
    You don't know what you're talking about, Mongo is as durable as PG.
    - AYBABTME 7y ago
      Given the history of both software, that is quite a bold rebuttal to make without providing any substance to back it.
alexnewman 7y ago
By durable, you mean If I turn the power on and off, the data will be there. I'm pretty sure it has this quality. The question of whether or not it has ACID semantics seems a nonstarter when we are discussing a simple blog

aprdm 7y ago

How is something meant as a durable store or not? I've worked in companies that had only ES as a database for years and they didn't had complaints. I've seen it working mostly well in these orgs and because of my now experience with it would likely strongly consider it as a database just like mongo and friends with the benefits of having a very large ecosystem (elk, beats etc.) Which can make it a one stop shop for all things in an org

vikingcaffiene 7y ago
ES is an eventually consistent data store meaning that it makes no guarantees about data availability when you put stuff in there. That alone should be a deal breaker for you. If you use ES for what it's designed to be and make it a projection of your underlying durable data store, you can do things like rebuild your index or change your schema without fear of data loss. Its a document store, not a database. MongoDB is too but they try to hide it by bolting on all the stuff traditional relational DB's have like ACID and transactions so you wont realize what a poor choice it is as a database when compared to say, Postgres.
- aprdm 7y ago
  That's not entirely true, it has its guarantees and ways of work is just not the same as more traditional SQL dbs and that's ok for tons of applications.
  - vikingcaffiene 7y ago
    Are you referring to the real time flag? My understanding is that that is per shard and if you try to pull from another shard that hasn't updated its index, you'd get stale data. Maybe you are referring to something else or I am wrong about that? It doesn't change the larger point that using ES as your primary database is not playing to its strengths. You're better served using a transactional data store and building your indexes from that.
- Thaxll 7y ago
  You don't know what you're talking about, Mongo is as durable as PG.
  - AYBABTME 7y ago
    Given the history of both software, that is quite a bold rebuttal to make without providing any substance to back it.

alexnewman 7y ago

By durable, you mean If I turn the power on and off, the data will be there. I'm pretty sure it has this quality. The question of whether or not it has ACID semantics seems a nonstarter when we are discussing a simple blog