karakanb

6 ms·

1. 31.▲
   by karakanb 8mo ago

   Hi, author here, thanks! I have used TypeScript before across various projects, but I haven't considered building CLI tooling in that before, I guess due to my prejudice against the whole JS ecosystem. I plan to give it another try in
2. 32.▲
   A case for Go as the best language for AI agents(getbruin.com)

   203 points by karakanb 8mo ago|293 comments
3. 33.▲
   Show HN: I built an MCP server to connect AI agents to your DWH

   1 points by karakanb 11mo ago|1 comments
4. 34.▲
   by karakanb 11mo ago

   I have been recently looking into extracting a bunch of details from a set of legacy invoice PDFs and had a subpar experience. Gemini was the best among the ones that I tried, but even that missed quite a bit. I'll definitely give this
5. 35.▲
   by karakanb 1y ago

   This seems to undermine the engineering muscle these companies have. Fivetran is well-capable of building a query engine, and with this merger, they also get access to SDF's query engine. They have the engineering capabilities, as well
6. 36.▲
   by karakanb 1y ago

   OpenFlow feels like an attempt at keeping customers within Snowflake boundaries, and while it might work for some, I see no way Snowflake being able to keep up with the data integration needs unless they allow another way of extending their
7. 37.▲
   by karakanb 1y ago

   Disclaimer: I am the co-founder of a dbt alternative, Bruin. ( https://github.com/bruin-data/bruin ) I think consolidation in the space has been coming for quite some time now and this merger only confirms what us, along
8. 38.▲
   The effective LLM multi-tenant security with SQL(getbruin.com)

   1 points by karakanb 1y ago|0 comments
9. 39.▲
   A story about hunting zombie tasks in a distributed environment(getbruin.com)

   22 points by karakanb 1y ago|3 comments
10. 40.▲
    by karakanb 2y ago

    This seems really interesting, thanks for sharing. I can see myself deploying something like this for some of our internal usecases, however the deployment options around such tooling seem to be rather complicated, especially when it comes
11. 41.▲
    Dbt Labs acquires SDF Labs(getdbt.com)

    109 points by karakanb 2y ago|48 comments
12. 42.▲
    by karakanb 2y ago

    while MySQL is very popular, it is very rare to see it in analytical/ML usecases, that's why we haven't added it yet. There's nothing from a technical POV that prevents us from adding, it just hasn't been a priority
13. 43.▲
    by karakanb 2y ago

    thanks! we already use DLT under the hood with ingestr, so some of our connectors already come from there. is that what you meant?
14. 44.▲
    by karakanb 2y ago

    hey, thanks a ton for sharing your thoughts, I appreciate that! I am sorry to hear that it didn't work, we do have a dedicated page for duckdb specifically here: https://bruin-data.github.io/bruin/platforms/du
15. 45.▲
    by karakanb 2y ago

    hey, thanks a lot for sharing your thoughts. I like the comparison page in Hamilton, and in their examples they operate in the asset level, whereas Bruin crosses the asset level into the orchestrator level as well, effectively bridging the
16. 46.▲
    by karakanb 2y ago

    love it, thanks!
17. 47.▲
    by karakanb 2y ago

    glad to hear you like it, thanks!!
18. 48.▲
    by karakanb 2y ago

    that's definitely coming, thanks!
19. 49.▲
    by karakanb 2y ago

    hey, I didn't know that, definitely gonna take a look. thanks!
20. 50.▲
    by karakanb 2y ago

    hey, absolutely. take a look at here: https://bruin-data.github.io/bruin/vscode-extension/overview...
21. 51.▲
    by karakanb 2y ago

    I would love to add a dedicated section on this, and would love to learn a bit more from you in this. Do you have any particular example tools that you would compare Bruin in your mind that you would like to understand the difference better
22. 52.▲
    by karakanb 2y ago

    depends on what you mean by that, but we do use dlt through ingestr ( https://github.com/bruin-data/ingestr ), which is used inside Bruin CLI.
23. 53.▲
    by karakanb 2y ago

    great point about the transformation pipeline, that's a very strong part of our motivation: it's never "just transformation", "just ingestion" or "just python", the value lies in being able to mix and
24. 54.▲
    by karakanb 2y ago

    I didn't know about Ray Data before, but just gave a quick look and it seems like a framework for ML workloads specifically? Bruin is effectively going a layer above individual assets, and instead takes a declarative approach to the fu
25. 55.▲
    by karakanb 2y ago

    thanks! I did look into CUE in the very early days of Bruin but ended up going with a more YAML-based configuration due to its support. I am not familiar with their flow package specifically, but I'll definitely take a deeper look. Fro
26. 56.▲
    by karakanb 2y ago

    thanks a lot for the kind words, James!
27. 57.▲
    by karakanb 2y ago

    hey, thanks for the shoutout! I love the idea, effectively allowing going towards a direction where the right platform for the right job is used, and it is very much in line with where we are taking things towards. Another interesting proje
28. 58.▲
    by karakanb 2y ago

    good point, thanks. I'll definitely add some more details about the comparison between different tools. I agree with you 100% on the language part, I think it is an interesting detail for a data tool to be built in Go, but we have a lo
29. 59.▲
    by karakanb 2y ago

    great question! Meltano, if I am not wrong, only does data ingestion (Extract & Load), whereas we go further into the pipeline such as transformation with SQL and Python, ML pipelines, data quality, and more. I guess a more comparable a
30. 60.▲
    by karakanb 2y ago

    Bruin orchestrates individual runs for single pipelines, which means you can use any tool to schedule the runs outside and the assets will be orchestrated by Bruin. You can use GitHub Actions, Airflow, a regular cronjob, or any other form o