3 ms·

https://getblast.io/ https://getblast.io/ - it is an end-to-end data platform: data ingestion + dbt-like transformations + data quality checks + data catalog, a

https://getblast.io/ https://getblast.io/ - it is an end-to-end data platform: data ingestion + dbt-like transformations + data quality checks + data catalog, all through a single interface. It is making ~$4k/month currently. Around the beginning of 2022, I was having a conversation with a few friends that are working at small mobile gaming companies, and they were having a lot of trouble building their data pipelines, especially because of the infrastructure part. I took on the challenge to start hosting some Airflow instances for them to get a bit more familiar with their problems, and over time some patterns started to emerge: - they were writing custom scripts for mundane tasks. - they had to write Python code, even though all they needed was scheduling a few SQL tasks. - they needed some basic transformation abilities, but didn't have the budget to pay dbt-cloud $50/month (the minimum plan is $100 these days, I believe). - they were losing track of where their data is going through and where it is coming from. A friend of mine and I have started building some abstractions on top of Airflow to help these businesses: no need to write any Python, automatically deploying their changes to their instances after a git push, building data quality checks, materializing their assets based on their SQL "SELECT" queries, etc. Over time, we have gathered these features into a shared UI, and moved some of these companies piece by piece. We keep improving the platform, and we are onboarding new companies for the past 2 months throughout our closed beta period. There are still many rough edges that we are trying to cover, but in the end, it was a great feeling when people were actually using the prouct quite often in spite of all these problems. We are pretty excited about where this can go. If anyone is interested in taking part in the beta program, the first 6 months is free during the beta period. Feel free to fill out the form on the website and I'll reach out personally.

anonu 4y ago
So you're building Snowflake. I love the idea... Lots of room to scale this to a unicorn.
- karakanb 4y ago
  Not sure if this is a snarky comment or not, but we are not building Snowflake, instead we are building the layer that goes on top of it. There are many businesses out there that have their data scattered across different platforms / tools / technologies, and our goal is to provide them visibility into their data, and let them get to the insights as quickly as possible without focusing on the infra. Our vision here is to bring the same set of abilities to the business even if some of their data lives in Snowflake, some in BigQuery, some in S3 and some in an Excel sheet somewhere. We are working to get to a point where working with all of these will become an easy task, without sacrificing governance, quality, speed or cost.

anonu 4y ago

So you're building Snowflake. I love the idea... Lots of room to scale this to a unicorn.

karakanb 4y ago
Not sure if this is a snarky comment or not, but we are not building Snowflake, instead we are building the layer that goes on top of it. There are many businesses out there that have their data scattered across different platforms / tools / technologies, and our goal is to provide them visibility into their data, and let them get to the insights as quickly as possible without focusing on the infra. Our vision here is to bring the same set of abilities to the business even if some of their data lives in Snowflake, some in BigQuery, some in S3 and some in an Excel sheet somewhere. We are working to get to a point where working with all of these will become an easy task, without sacrificing governance, quality, speed or cost.