3 ms·

Was using Postgres Aurora RDS at a startup client last year, and the Aurora costs were through the roof. We had some moderately inefficient union queries that b

Was using Postgres Aurora RDS at a startup client last year, and the Aurora costs were through the roof. We had some moderately inefficient union queries that burned through credits like no tomorrow. Just a handful of users lightly using the system cost about $3,000 a month. I loved everything else about it. Edit: it was real estate market data, so only about 15 million rows.

elteto 3y ago
You could probably keep 15 million rows in a csv file and still get great performance. Without even mentioning sqlite. Any reason to use such an overkill solution for that problem? Honest question, not passing judgement.
- Scubabear68 3y ago
  I inherited it from the prior CTO and team. This was one of the better solutions they had. They also had Talend for ETL and Snowflake for “analysis”. You don’t want to know what Snowflake cost. For the same roughly 15 millions rows…
  - bomewish 3y ago
    This is just so incredibly incompetent. What gives? I would expect this in government but in a company incentives are meant to be aligned.
    - Scubabear68 3y ago
      The prior CTO came from much larger, highly regulated startups. His only experience was very large scale systems with complex requirements. He took the approach that worked there to this much smaller, mostly unregulated startup in a very different industry. It happened because he was the only semi technical person who was an FTE. Everyone else was from a consulting firm that the private equity owners “suggested” they use.
      - bomewish 3y ago
        That explains a lot. It’s still a case of incompetence but this gives it a clearer explanation.
    - gopher_space 3y ago
      Government is not only compatible with competence; it is a profound source of competence. When we recognize our place in an immensity of people and in the passage of ages, when we grasp the intricacy, beauty, and subtlety of public life, then that soaring feeling, that sense of elation and humility combined, is surely civic. The notion that government and competence are somehow mutually exclusive does a disservice to both.

elteto 3y ago

You could probably keep 15 million rows in a csv file and still get great performance. Without even mentioning sqlite. Any reason to use such an overkill solution for that problem? Honest question, not passing judgement.

Scubabear68 3y ago
I inherited it from the prior CTO and team. This was one of the better solutions they had. They also had Talend for ETL and Snowflake for “analysis”. You don’t want to know what Snowflake cost. For the same roughly 15 millions rows…
- bomewish 3y ago
  This is just so incredibly incompetent. What gives? I would expect this in government but in a company incentives are meant to be aligned.
  - Scubabear68 3y ago
    The prior CTO came from much larger, highly regulated startups. His only experience was very large scale systems with complex requirements. He took the approach that worked there to this much smaller, mostly unregulated startup in a very different industry. It happened because he was the only semi technical person who was an FTE. Everyone else was from a consulting firm that the private equity owners “suggested” they use.
    - bomewish 3y ago
      That explains a lot. It’s still a case of incompetence but this gives it a clearer explanation.
  - gopher_space 3y ago
    Government is not only compatible with competence; it is a profound source of competence. When we recognize our place in an immensity of people and in the passage of ages, when we grasp the intricacy, beauty, and subtlety of public life, then that soaring feeling, that sense of elation and humility combined, is surely civic. The notion that government and competence are somehow mutually exclusive does a disservice to both.