4 ms·

duckdb is a generational technology innovation. insanely good ergonomics, great performance, it's awesome.

goerch 6mo ago
Can confirm: together with `dbt` and `rill` I'm able do to [this](https://github.com/idesis-gmbh/GitHubExperiments/blob/master/explore.gif https://github.com/idesis-gmbh/GitHubExperiments/blob/master...) on my laptop.
- steve_adams_86 6mo ago
  Whoa, nice! I could see this being useful to people I work with. Do you think it would be a good setup for people who are technical but not great software developers? People who use basic R and Python for ETL and analysis, mostly.
  - goerch 6mo ago
    I'm using DuckDB in another project (on my laptop) where `NetworkX` fails due to the memory limit of 32 GB. So yes, as soon as you are doing out of core work I'd assume the combination to be quite powerful. Knowledge in SQL would be a plus, though.
- esafak 6mo ago
  Why did you pick rill?
  - goerch 6mo ago
    It is a educational/R&D type project. We are more of backend developers and `rill` worked fine as a rapid visualization frontend with low learning curve for us. Edit: still realizing that I can't use markdown on HN...
- rick1290 6mo ago
  is rill open source?
  - goerch 6mo ago
    https://github.com/rilldata/rill https://github.com/rilldata/rill, Apache 2.0 license
- janandonly 6mo ago
  OP here. Thanks for sharing. This is why I keep coming back to HN.
steve_adams_86 6mo ago
I use it almost daily. Any time I benchmark changes or analyze logs, I collect the data I need as CSV and analyze it with duckdb. The flexibility and ease makes it so I find so much more interesting information. It's indispensable to me now
meetingthrower 6mo ago
I got introduced to it by Claude the other day as I was interrogating several GB of public csv files. Seemed magical as it out them all in parquet files and transformed what I needed into the normalized sqllite for my server. Coding agents seen quite comfortable with it!
- whalesalad 6mo ago
  claude + duckdb combo is legendary for doing quick analysis of huge datasets. every time i need to analyze a big ass csv (200mb+) or as you noted a parquet file or really anything columnar i'll tell claude, 'you have duckdb at your disposal for this' and within minutes it's all sorted (no pun intended)

Can confirm: together with `dbt` and `rill` I'm able do to [this](https://github.com/idesis-gmbh/GitHubExperiments/blob/master/explore.gif https://github.com/idesis-gmbh/GitHubExperiments/blob/master...) on my laptop.

steve_adams_86 6mo ago
Whoa, nice! I could see this being useful to people I work with. Do you think it would be a good setup for people who are technical but not great software developers? People who use basic R and Python for ETL and analysis, mostly.
- goerch 6mo ago
  I'm using DuckDB in another project (on my laptop) where `NetworkX` fails due to the memory limit of 32 GB. So yes, as soon as you are doing out of core work I'd assume the combination to be quite powerful. Knowledge in SQL would be a plus, though.
esafak 6mo ago
Why did you pick rill?
- goerch 6mo ago
  It is a educational/R&D type project. We are more of backend developers and `rill` worked fine as a rapid visualization frontend with low learning curve for us. Edit: still realizing that I can't use markdown on HN...
rick1290 6mo ago
is rill open source?
- goerch 6mo ago
  https://github.com/rilldata/rill https://github.com/rilldata/rill, Apache 2.0 license
janandonly 6mo ago
OP here. Thanks for sharing. This is why I keep coming back to HN.

steve_adams_86 6mo ago

I use it almost daily. Any time I benchmark changes or analyze logs, I collect the data I need as CSV and analyze it with duckdb. The flexibility and ease makes it so I find so much more interesting information. It's indispensable to me now

meetingthrower 6mo ago

I got introduced to it by Claude the other day as I was interrogating several GB of public csv files. Seemed magical as it out them all in parquet files and transformed what I needed into the normalized sqllite for my server. Coding agents seen quite comfortable with it!

whalesalad 6mo ago
claude + duckdb combo is legendary for doing quick analysis of huge datasets. every time i need to analyze a big ass csv (200mb+) or as you noted a parquet file or really anything columnar i'll tell claude, 'you have duckdb at your disposal for this' and within minutes it's all sorted (no pun intended)