karakanb

8 ms·

1. 61.▲
   Show HN: I built an open-source data pipeline tool in Go(github.com)

   200 points by karakanb 2y ago|48 comments
2. 62.▲
   by karakanb 2y ago

   Genuine question: instead of self-driving cars, why don't we have remote controlled cars all around? With cameras all around the visibility would not be as terrible, together with the current self-driving capabilities which can get thr
3. 63.▲
   Visiting San Francisco as a European Resident(burakkarakan.com)

   1 points by karakanb 2y ago|0 comments
4. 64.▲
   by karakanb 2y ago

   It still blows my mind that Google Docs still haven't taken over Notion's business altogether. I have used Notion for ~6 months for my own company, ended up going back to Google Docs because it was not worth it. I am sure there ar
5. 65.▲
   by karakanb 2y ago

   looks interesting, thanks for sharing. What's the difference between this and the official ChatGPT app?
6. 66.▲
   The Pains of Data Ingestion(blog.getbruin.com)

   1 points by karakanb 3y ago|0 comments
7. 67.▲
   by karakanb 3y ago

   Hi there, thanks a lot for your comment and trying it out. Do you mind joining our Slack community via the link in the readme or create a github issue so that we can dive into this? I'd love to understand what doesn't work and pro
8. 68.▲
   by karakanb 3y ago

   on it!
9. 69.▲
   by karakanb 3y ago

   couldn't agree more! I see ingestr more as a common-scenario solution rather than a general solution that solves all cases, kinda like how I treat shell oneliners instead of writing an applicataion in another language. I guess there&#x
10. 70.▲
    by karakanb 3y ago

    thanks a lot for your comment, glad to hear we converged on a similar idea! :)
11. 71.▲
    by karakanb 3y ago

    it's on my roadmap for sure!
12. 72.▲
    by karakanb 3y ago

    I have just released supporting local CSV file as a source in v0.1.3, let me know if this helps! :)
13. 73.▲
    by karakanb 3y ago

    I don't think I invented anything tbh, I just relied on SQLAlchemy's URI formats, and I decided to abuse it slightly for even more config.
14. 74.▲
    by karakanb 3y ago

    Also released local CSV file as a source in v0.1.3.
15. 75.▲
    by karakanb 3y ago

    I have released v0.1.2 with the destination literally minutes ago, I'll take a look at CSV as a source! just so that I have a better understanding, do you mind explaining your usecase?
16. 76.▲
    by karakanb 3y ago

    I have just released v0.1.2 which supports CSV destinations with the URI format `csv://path/to/file.csv`, hope that's helpful!
17. 77.▲
    by karakanb 3y ago

    I have just released v0.1.2 which supports CSV destinations with the URI format `csv://path/to/file.csv`, hope that's helpful!
18. 78.▲
    by karakanb 3y ago

    thanks a lot Peter!
19. 79.▲
    by karakanb 3y ago

    hmm, that's an interesting question, I don't know the answer to be honest. are you able to run external scripts on the device? if so, you might be able to install & run ingestr with a CSV destination (which I released literall
20. 80.▲
    by karakanb 3y ago

    Do you mean SQL Server? If that's the case, ingestr is already able to connect to Microsoft SQL Server and use it both as a source and a destination.
21. 81.▲
    by karakanb 3y ago

    I agree, I am looking into it right now!
22. 82.▲
    by karakanb 3y ago

    I added it as an experimental source a few hours ago, but I haven't had the chance to test it, that's why I haven't put it into the support matrix yet. Do you mind trying it out if you do use Oracle?
23. 83.▲
    by karakanb 3y ago

    It does handle schema evolution wherever it can, including inferring the initial schema automatically based on the source and destination as well, which means there's no need for manual schema changes anywhere and it will keep them in
24. 84.▲
    by karakanb 3y ago

    I do use the dlt library to support as many source & destinations as possible and they do not support SQLite as of today. I am interested in supporting SQLite simply because I love it as well, so that's definitely in the roadmap. d
25. 85.▲
    by karakanb 3y ago

    I am working on file support right now as a destination to begin with. I believe I should get local files as well as S3-compatible sources going by tonight. Reading the sources in parallel is an interesting idea, I'll definitely take a
26. 86.▲
    by karakanb 3y ago

    Glad to hear that! I am not 100% sure if it’ll look pretty for all platforms but I hope it’ll be an okay base to get started!
27. 87.▲
    by karakanb 3y ago

    hey, thanks! I guess there were a couple of things that I found as tricky: - deciding on the right way to represent sources and destinations was hard, before landing on URIs I thought of using config files but that'd also add additiona
28. 88.▲
    Show HN: I built an open-source data copy tool called ingestr(github.com)

    156 points by karakanb 3y ago|48 comments
29. 89.▲
    by karakanb 3y ago

    Disclaimer: I am the co-founder of a competitor, Bruin ( https://getbruin.com ). We are exactly the kind of integrated platform Tristan is talking about. The article resonates with me a lot, and it is because we called this out mo
30. 90.▲
    The Mythical Data Team(getbruin.com)

    1 points by karakanb 3y ago|0 comments