tayloramurphy

8 ms·

61.
by tayloramurphy 5y ago
The Work OS category is confusing since I was more familiar with WorkOS[0] already. I didn't connect how these were related (which they really aren't). [0] https://workos.com/
62.
by tayloramurphy 6y ago
I originally thought this article was going to be about John Berryman's proposed Redis rate limiter [0] [0] http://blog.jnbrymn.com/2021/03/18/estimated-average-recent-...
63.
by tayloramurphy 6y ago
We also published a short blog post on this if anyone is curious! https://meltano.com/blog/2021/04/07/a-simplified-take-on-the...
64.
A simplified take on the Singer specification(meltano.com)
4 points by tayloramurphy 6y ago|1 comments
65.
Meltano Launches the Singer Tap SDK(meltano.com)
3 points by tayloramurphy 6y ago|0 comments
66.
by tayloramurphy 6y ago
The GitLab Data Team is running Meltano in production[0]. We're currently extracting Zoom data with it and have plans for several more extractors (Slack, GMail, PTO by Roots, EdCast, and a few more). I just made this MR[1] to update th
67.
by tayloramurphy 6y ago
This article[0] from Census is a good primer on the difference and what's driving it. But the TL;DR is that storage is cheap and it's easier to change SQL-based transformations using something like dbt[1] than to re-extract the da
68.
by tayloramurphy 6y ago
We're working on an SDK[0] for building taps that should make it much easier to build to the Singer spec with all of the features out of the box. In theory if you can write some python against whatever you're pulling data out of,
69.
by tayloramurphy 6y ago
Yep! We have this issue[0] open. I'm also interested in getting Prefect and GitLab CI as orchestrators too. [0] https://gitlab.com/meltano/meltano/-/issues/2393
70.
by tayloramurphy 6y ago
I'm not aware of any. I did just open this issue[0] in the Meltano project to open discussion with the team/community. It could be an interesting iteration on the Singer Spec[1] if we find that users are interested in it and it he
71.
by tayloramurphy 6y ago
It's dependent on your use case, but the three examples you've listed here all have a slightly different approach to the market. Stitch (as mentioned in a comment below) is SaaS only. Pipelinewise is open source but as far as I kn
72.
by tayloramurphy 6y ago
You're correct, it currently does integrate with Airflow and dbt. I'm a big fan of both having used them basically every day for the past 3 years. The dbt community has done wonders for me personally and professionally and we&#x27
73.
by tayloramurphy 6y ago
Yep - here's the link to the podcast [0]. And you're correct, it is a project with GitLab. For the past year or so there's been 1 person on the project, but there are now 2 (today is when I switch from the GitLab Data team to