4 ms·

The Open Source Fivetran alternative. Yay, it was about time! A simple license : MIT. Clear differentiation between free & paid plans. I am liking what I am se

The Open Source Fivetran alternative. Yay, it was about time! A simple license : MIT. Clear differentiation between free & paid plans. I am liking what I am seeing so far. One of our client is in advertising industry and is syncing data from 20 different API vendors to postgres. So I am one of your potential customer. However, there is a big problem I'm noticing with "Open source alternatives" lately on HN. I had to mention this. Even a simple installation of airbyte on my local machine fails :( I tried docker-compose up! I simply wanna know why a basic example is not working on an important day of your company ? :) Is this a genuine mistake ? Sorry, this feedback will sound harsh but companies are taking words 'open source' for a complete ride. It's a great marketing trick. Gets you plenty of eyeballs, good will & trust to begin with. Then later we figure it's not even self hostable. Here is a bad example that you may not want to follow : Supabase "The Open Source Firebase Alternative". The product is not self hostable despite calling themselves open source firebase all over internet. The Founders of Supabase have been disingenuous not to address self hosting[1][2] and its a been long time since their launch. The self hosting section on their website[3] doesn't provide any details on how to self host and they are careless enough to even mention "how to migrate away" from Supabase in that section. [1] : https://github.com/supabase/supabase/discussions/219#discussioncomment-231261 https://github.com/supabase/supabase/discussions/219#discuss... [2] : https://github.com/supabase/supabase/issues/85#issuecomment-741528624 https://github.com/supabase/supabase/issues/85#issuecomment-... [3] : https://supabase.io/docs/guides/platform#self-hosting https://supabase.io/docs/guides/platform#self-hosting

mtricot 6y ago
Sorry that it doesn't work :( Murphy law on launch day I would say... Right now all our users self-host and the whole project is meant to be self-hosted for data privacy and security reasons. Do you want to join our slack (https://slack.airbyte.io https://slack.airbyte.io)? We can help you on the resolution!
- yclurker 6y ago
  Traceback (most recent call last): File "site-packages/urllib3/connectionpool.py", line 677, in urlopen File "site-packages/urllib3/connectionpool.py", line 392, in _make_request File "http/client.py", line 1252, in request File "http/client.py", line 1298, in _send_request File "http/client.py", line 1247, in endheaders File "http/client.py", line 1026, in _send_output File "http/client.py", line 966, in send File "site-packages/docker/transport/unixconn.py", line 43, in connect
  - mtricot 6y ago
    Thanks for posting! I don't have enough context to help you solve. Do you want to send a screenshot of your terminal? michel [@] airbyte.io
  - la6471 6y ago
    Isn’t there a GitHub issue submission page?
    - jeanlaf 6y ago
      Sure, we do: https://github.com/airbytehq/airbyte/issues/new/choose https://github.com/airbytehq/airbyte/issues/new/choose
kiwicopple 6y ago
hey yclurker, Supabase founder here. I'm sorry we haven't delivered a better self-hosting experience. This is clearly something we could do better. As I mentioned in your link[1], we're targeting a release of our CLI in Q1 (last week of march). > its a been long time since their launch It has been 8 months since our alpha launch*, and just over 1 month since our beta. I hope that sets some context, because personally I think we (and the community) have delivered a lot in that time. I'm very proud of what our small team has been able deliver. > The product is not self hostable Note that Supabase is self-hostable, it's just lacking documentation, which we will rectify in Q1. [*alpha]: https://news.ycombinator.com/item?id=23319901\ https://news.ycombinator.com/item?id=23319901\*
- yclurker 6y ago
  @kiwicopple : I'm really sorry to say this, I understand you try your best to sound reasonable every time. It's just that you alone believe that we can't see past your replies. But it is pretty evident that you wont make Supabase self hostable. Dude, even proprietary closed products provide docker / docker-compose by default in their repos. Quite honestly, shame on Supabase for setting such a shady example.
  - kiwicopple 6y ago
    In the link you shared I mention how to get the docker-compose file by running `supabase eject` I probably can't satisfy you, but I'll make our intentions very clear to everyone else reading this: https://github.com/supabase/supabase/commit/913add2e3ca45e55093d8da408143b8c947cef88 https://github.com/supabase/supabase/commit/913add2e3ca45e55... Sorry for the lack of documentation - we will add more docs and make everything easier to use before a "Launch week" that we have planned on the last week of March.
    - yclurker 6y ago
      From your commit in README.md >> You can emulate Supabase using `docker-compose` by following these steps inside the `./docker` folder. What does even emulating mean for an open source product ? Why do I want to emulate and not run the real thing. >> I probably can't satisfy you Dude, if you can show me one another product which claims to be "open source" that can't be self hosted I will admit it.
crunchtoinfo 6y ago
I can confirm that self-hosted is the best of both worlds: fully private and you control the access through your own infrastructure and all works in the browser. This simplicity is important for many small-medium companies. That is why my go-to tools for adhoc data slicing by non-technical users is https://www.metabase.com https://www.metabase.com. I hope that Airbyte/dbt will be the ELT complement. And I hope to find a way to contribute.
- bleonard 6y ago
  To continue to compliment this stack, feel free to check out Grouparoo, a "reverse ETL" tool that is also self-hosted. https://www.grouparoo.com https://www.grouparoo.com
- mtricot 6y ago
  Perfectly timed comment :) we are currently writing a tutorial at the moment to showcase how to use Airbyte/DBT/Metabase together
- seektable 6y ago
  Shameless plug: for adhoc reporting by non-technical users our https://www.seektable.com https://www.seektable.com also can be considered (esp. if your users heavily use pivot tables), it is closed-source but has a fully functional free accounts & self-hosted version.

mtricot 6y ago

Sorry that it doesn't work :( Murphy law on launch day I would say... Right now all our users self-host and the whole project is meant to be self-hosted for data privacy and security reasons. Do you want to join our slack (https://slack.airbyte.io https://slack.airbyte.io)? We can help you on the resolution!

yclurker 6y ago
Traceback (most recent call last): File "site-packages/urllib3/connectionpool.py", line 677, in urlopen File "site-packages/urllib3/connectionpool.py", line 392, in _make_request File "http/client.py", line 1252, in request File "http/client.py", line 1298, in _send_request File "http/client.py", line 1247, in endheaders File "http/client.py", line 1026, in _send_output File "http/client.py", line 966, in send File "site-packages/docker/transport/unixconn.py", line 43, in connect
- mtricot 6y ago
  Thanks for posting! I don't have enough context to help you solve. Do you want to send a screenshot of your terminal? michel [@] airbyte.io
- la6471 6y ago
  Isn’t there a GitHub issue submission page?
  - jeanlaf 6y ago
    Sure, we do: https://github.com/airbytehq/airbyte/issues/new/choose https://github.com/airbytehq/airbyte/issues/new/choose

kiwicopple 6y ago

hey yclurker, Supabase founder here. I'm sorry we haven't delivered a better self-hosting experience. This is clearly something we could do better. As I mentioned in your link[1], we're targeting a release of our CLI in Q1 (last week of march). > its a been long time since their launch It has been 8 months since our alpha launch*, and just over 1 month since our beta. I hope that sets some context, because personally I think we (and the community) have delivered a lot in that time. I'm very proud of what our small team has been able deliver. > The product is not self hostable Note that Supabase is self-hostable, it's just lacking documentation, which we will rectify in Q1. [*alpha]: https://news.ycombinator.com/item?id=23319901\ https://news.ycombinator.com/item?id=23319901\*

yclurker 6y ago
@kiwicopple : I'm really sorry to say this, I understand you try your best to sound reasonable every time. It's just that you alone believe that we can't see past your replies. But it is pretty evident that you wont make Supabase self hostable. Dude, even proprietary closed products provide docker / docker-compose by default in their repos. Quite honestly, shame on Supabase for setting such a shady example.
- kiwicopple 6y ago
  In the link you shared I mention how to get the docker-compose file by running `supabase eject` I probably can't satisfy you, but I'll make our intentions very clear to everyone else reading this: https://github.com/supabase/supabase/commit/913add2e3ca45e55093d8da408143b8c947cef88 https://github.com/supabase/supabase/commit/913add2e3ca45e55... Sorry for the lack of documentation - we will add more docs and make everything easier to use before a "Launch week" that we have planned on the last week of March.
  - yclurker 6y ago
    From your commit in README.md >> You can emulate Supabase using `docker-compose` by following these steps inside the `./docker` folder. What does even emulating mean for an open source product ? Why do I want to emulate and not run the real thing. >> I probably can't satisfy you Dude, if you can show me one another product which claims to be "open source" that can't be self hosted I will admit it.

crunchtoinfo 6y ago

I can confirm that self-hosted is the best of both worlds: fully private and you control the access through your own infrastructure and all works in the browser. This simplicity is important for many small-medium companies. That is why my go-to tools for adhoc data slicing by non-technical users is https://www.metabase.com https://www.metabase.com. I hope that Airbyte/dbt will be the ELT complement. And I hope to find a way to contribute.

bleonard 6y ago
To continue to compliment this stack, feel free to check out Grouparoo, a "reverse ETL" tool that is also self-hosted. https://www.grouparoo.com https://www.grouparoo.com
mtricot 6y ago
Perfectly timed comment :) we are currently writing a tutorial at the moment to showcase how to use Airbyte/DBT/Metabase together
seektable 6y ago
Shameless plug: for adhoc reporting by non-technical users our https://www.seektable.com https://www.seektable.com also can be considered (esp. if your users heavily use pivot tables), it is closed-source but has a fully functional free accounts & self-hosted version.