Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
aruntdharan
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
6 ms
·
1.
▲
by
aruntdharan
3y ago
Thanks! Yes, for sure - pivoting at the right time is important.
2.
▲
Show HN: Castled Data – Customer engagement software on top of data warehouses
10 points
by
aruntdharan
3y ago
|
6 comments
3.
▲
Show HN: API to Generate SQL on Top of Cloud Data Warehouses
2 points
by
aruntdharan
4y ago
|
0 comments
4.
▲
by
aruntdharan
4y ago
Hi HN! We are excited to share something we have been building for the last year. Castled is a marketing automation platform built on data warehouses like Snowflake, BigQuery, Redshift, and Postgres. Castled allows you to directly use the u
5.
▲
by
aruntdharan
4y ago
Hi Thom - Yes Clickhouse is definitely there on our roadmap. We already have multiple customers asking for it.
6.
▲
Send emails directly on top of Snowflake (YC W22)
(castled.io)
4 points
by
aruntdharan
4y ago
|
3 comments
7.
▲
by
aruntdharan
4y ago
Hi HN, We're Arun, Frank and Abhilash from Castled Data( https://castled.io ). Castled is a marketing automation platform built directly on top of modern data warehouses like Snowflake, BigQuery, Redshift, and Postgres. Here
8.
▲
Castled - Warehouse-Native Braze Alternative
(castled.io)
8 points
by
aruntdharan
4y ago
|
2 comments
9.
▲
by
aruntdharan
4y ago
Hi HN, We're Frank, Abhilash, and Arun from Castled Data( https://castled.io ). Castled is a marketing automation platform built directly on top of modern data warehouses like Snowflake, BigQuery, Redshift, and Postgres. Here
10.
▲
by
aruntdharan
5y ago
Sorry about that! But its actually the registration for signup and not for updates. Thats why we had to block personal emails.
11.
▲
by
aruntdharan
5y ago
Thanks for letting us know!
12.
▲
by
aruntdharan
5y ago
Thats a great question! We dont use updated timestamps to compute deltas, as thats unreliable and can cause data loss depending on your transaction window. We keep snapshot tables on your data warehouse(in our own custom schema, so that you
13.
▲
by
aruntdharan
5y ago
Thanks for the input!
14.
▲
by
aruntdharan
5y ago
We can definitely consider that. But I feel its a lot of config and can be error prone. For instance, source-destination field mapping configs might be complex and have various issues like data type mismatches, typos in field names etc and
15.
▲
by
aruntdharan
5y ago
You mean the warehouse/app credentials, when you say sync configurations? If so, yes, that seems like a great idea. Infact I think your warehouse credentials are already there in your dbt repo in a specific format. Castled can directly
16.
▲
by
aruntdharan
5y ago
Fixed :)
17.
▲
by
aruntdharan
5y ago
Thanks!
18.
▲
by
aruntdharan
5y ago
A year back when we started to built Castled, this technology which syncs data from cloud warehouses to your operational tools did not have a name. The term "Reverse ETL" became popular somewhere in the beginning of 2021. We used
19.
▲
by
aruntdharan
5y ago
Just checked it out. Looks interesting. Thanks
20.
▲
by
aruntdharan
5y ago
The founding team of Castled comprises mostly founding engineers from HevoData, which is an ETL solution. Having built both ETL and Reverse ETL solutions from scratch, we have realized that the architecture required to support both ETL and
21.
▲
by
aruntdharan
5y ago
Noted. We will definitely consider adding support for python. Thanks for the suggestion.
22.
▲
by
aruntdharan
5y ago
Thanks for the tip. We believe it's still the data engineers who will have to write these reverse connectors as well. We understand that python is probably the preferred choice of language for them. We have also seen that a majority of
23.
▲
by
aruntdharan
5y ago
Thanks for the suggestion. Yes, a devkit would work if its just about building new connectors. But we believe that the community would want control over the entire project rather than just the connectors module. We also wanted to provide a
24.
▲
by
aruntdharan
5y ago
Thanks! We also have a subscription based hosted solution hosted at https://castled.io
25.
▲
Launch HN: Castled Data (YC W22) – Open-Source Reverse ETL
(github.com)
87 points
by
aruntdharan
5y ago
|
47 comments