mtricot

7 ms·

1. 31.▲
   by mtricot 6y ago

   Perfectly timed comment :) we are currently writing a tutorial at the moment to showcase how to use Airbyte/DBT/Metabase together
2. 32.▲
   by mtricot 6y ago

   Thanks! will look at it!
3. 33.▲
   by mtricot 6y ago

   Airbyte addresses two pains of data engineers: - having to build and maintain connectors - managing data integration pipelines on behalf of less technical profiles Because Airtybe is UI/API based, we can offer a great experience to les
4. 34.▲
   by mtricot 6y ago

   You're welcome! Glad you liked it!
5. 35.▲
   by mtricot 6y ago

   Exactly! Every engineers we talked to want it out of their plate. Which is why we believe it should be commoditized with an open-source standard.
6. 36.▲
   by mtricot 6y ago

   Building connectors is a 1000-paper cuts problem. The community will encounter more of these edge cases than anyone who keeps a version of the connector internally and tries to improve it without contributing back. With this in mind, GPL wo
7. 37.▲
   by mtricot 6y ago

   Thank you for your kind words! The breadth of connectors is a large part of it, as well as the fact that we are by design multi-cloud, so we limit the vendor lock-in. We are not too worried about other providers using our technology. The go
8. 38.▲
   by mtricot 6y ago

   We don’t today, we will tomorrow when we start working on CDC. You’re raising a good point with MySQL, we will need to take this limitation into account. Hopefully there is a workaround.
9. 39.▲
   by mtricot 6y ago

   You can also use an external connector if you want to. This is a very valid use-case, especially if you connect internal APIs or private sources that wouldn't make sense for the community. If the original contributor falls off the face
10. 40.▲
    by mtricot 6y ago

    we are still figuring out how we want to integrate with other schedulers. One option would be that you configure your source/destination with the Airbyte UI or API and with the external scheduler you just reference to a connection obje
11. 41.▲
    by mtricot 6y ago

    Thanks for posting! I don't have enough context to help you solve. Do you want to send a screenshot of your terminal? michel [@] airbyte.io
12. 42.▲
    by mtricot 6y ago

    You can. You can play the the env variable: API_URL For example if you have a reverse proxy that serves both the webapp and the api you can just launch with: API_URL=/api/v1/ docker-compose up
13. 43.▲
    by mtricot 6y ago

    Sorry that it doesn't work :( Murphy law on launch day I would say... Right now all our users self-host and the whole project is meant to be self-hosted for data privacy and security reasons. Do you want to join our slack ( https:&#x2F
14. 44.▲
    by mtricot 6y ago

    Yes! it is on our short term roadmap: https://github.com/airbytehq/airbyte/issues/1483 Also, we are OSS so if you want to contribute, we can guide you through it!
15. 45.▲
    by mtricot 6y ago

    It is not possible as of now but we are about to start integrating with DAG managers (Airflow, Dagster, Prefect...). That will give the possibility to schedule the connectors with the proper dependencies. See: https://github.com&
16. 46.▲
    by mtricot 6y ago

    Yes, it is on our roadmap. We will likely have an alpha version in the next two months. https://github.com/airbytehq/airbyte/issues/957
17. 47.▲
    by mtricot 6y ago

    Yes, we love DBT too! It’s great for handling transformations and since we want to focus on the EL part, we think there’s good synergy there. Airbyte is already using the DBT CLI internally and as we provide more transformations of the data
18. 48.▲
    by mtricot 6y ago

    Answering your first question: When talking about the interface we need to separate: the data protocol and the developer experience (DX) creating & maintaining a connector. We believe the data protocol we have in place should address 9
19. 49.▲
    by mtricot 6y ago

    Forgot to mention. We have a compatibility layer with Singer so it possible to run Singer Taps in Airbyte. We have a few sources that are actually some of the high quality Singer's.
20. 50.▲
    by mtricot 6y ago

    I am one of Airbyte's founder. The initial version of was actually fully based on Singer and this is when we realize it wouldn't be possible for us to depend on it. Amongst the main reasons: Singer seems to have been abandoned by
21. 51.▲
    Launch HN: Airbyte (YC W20) – Open-Source ELT (Fivetran/Stitch Alternative)

    178 points by mtricot 6y ago|87 comments