4 ms·

No no it is insanely useful and I wish I had a job where I could use it more! Noone really has big big data, they only think they do. You can do the analytics

No no it is insanely useful and I wish I had a job where I could use it more! Noone really has big big data, they only think they do. You can do the analytics that Databricks and Snowflake are trying to sell your boss for $100.000 a month, only then on an 80$ vps and a couple of S3 buckets full of parquet files. It's a fantastic tool to run analytics. Lean, purposeful. I hope they can manage to stay out of the clutches of corporate enshittification for a while longer.

ramraj07 3y ago
You seem to be quite sure of how useful duckdb is even though you haven’t found a use case for it. This is actually a common pattern I’ve seen everywhere - the people super excited about duckdb are people who never use it in their job and at best for toy use cases. If your data is truly small enough to run on a vps with duckdb, your monthly snowflake bill will not break a few hundred dollars by any stretch. A terabyte stored on snowflake costs 23 bucks a month and running a query on it depending on complexity will cost no more than a dollar. And you don’t pay any cost other than these two.
- pradeepchhetri 3y ago
  Wow I didn't know that snowflake charges on query level. Very good business idea to first create dependency and rip them off once their business grows.
  - ramraj07 3y ago
    Not disagreeing, but pick a lane - is your data too small or too big? The discussion here was about data thats allegedly too small to be called "big data"..
  - hodgesrm 3y ago
    > Wow I didn't know that snowflake charges on query level. It doesn't. You get charged "credits" for virtual data warehouse operation plus storage. A credit corresponds (approximately) to running a VM of a certain size for an hour. You can turn VDWs on and off more or less at will. Not taking a position on whether that's good for users or not. Just pointing out how it works.

ramraj07 3y ago

You seem to be quite sure of how useful duckdb is even though you haven’t found a use case for it. This is actually a common pattern I’ve seen everywhere - the people super excited about duckdb are people who never use it in their job and at best for toy use cases. If your data is truly small enough to run on a vps with duckdb, your monthly snowflake bill will not break a few hundred dollars by any stretch. A terabyte stored on snowflake costs 23 bucks a month and running a query on it depending on complexity will cost no more than a dollar. And you don’t pay any cost other than these two.

pradeepchhetri 3y ago
Wow I didn't know that snowflake charges on query level. Very good business idea to first create dependency and rip them off once their business grows.
- ramraj07 3y ago
  Not disagreeing, but pick a lane - is your data too small or too big? The discussion here was about data thats allegedly too small to be called "big data"..
- hodgesrm 3y ago
  > Wow I didn't know that snowflake charges on query level. It doesn't. You get charged "credits" for virtual data warehouse operation plus storage. A credit corresponds (approximately) to running a VM of a certain size for an hour. You can turn VDWs on and off more or less at will. Not taking a position on whether that's good for users or not. Just pointing out how it works.