5 ms·

Show HN: WhatTheDuck – open-source, in-browser SQL on CSV files

119 points by slake 3y ago

WhatTheDuck is an in-browser sql tool to analyze csv files that uses duckdb-wasm under the hood. Please provide feedback/issues/pull requests.

yogini 3y ago
Loved the idea and the entire project! Starred it on GitHub. One suggestion, when I land on the website I would love to see a small example already added. Basic CSV and some SQL queries to run and play with. It would be best if you also launch it on Peerlist. Many people are working in a similar space there, they also might find this useful.
refset 3y ago
Looks nice! I would suggest to pointing users to a small demo csv file and query that can be quickly loaded/pasted to see it working. Or even have a "Load example CSV and query" button.
- pratik227 3y ago
  We have added an upload sample file button thanks for feedback @refset
- slake 3y ago
  Sounds like a good idea. We'll get to it.
boiler_up800 3y ago
IDE support is definitely one area where DuckDB could be better. My current workflow is to edit SQL files in VS Code and then use ‘.read’ within the DuckDB CLI.
- fastasucan 3y ago
  Same here. You have Harlequin which is worth a try, but ideally I would just write and execute in vscode.
- reportgunner 3y ago
  I don't use DuckDB but I use the community version of DBeaver for SQL - looks like it supports DuckDB too[0] [0] https://duckdb.org/docs/guides/sql_editors/dbeaver.html https://duckdb.org/docs/guides/sql_editors/dbeaver.html
- chrisjc 3y ago
  Keep an eye on this link. New support is being added every so often. https://github.com/davidgasquez/awesome-duckdb?tab=readme-ov-file#sql-clients-and-ide-that-support-duckdb https://github.com/davidgasquez/awesome-duckdb?tab=readme-ov...
  - pratik227 3y ago
    Yes we have added there as well the PR is merged
hantusk 3y ago
I liked SQL workbench (https://news.ycombinator.com/item?id=39537794 https://news.ycombinator.com/item?id=39537794) which has the same core ideas but more usable features at this point (query history, parquet support and charts) - if you hadn't seen it maybe some of its features will inspire you.
- tobilg 3y ago
  Thanks you, https://sql-workbench.com https://sql-workbench.com author here :-) Let me know if you have some feature requests / bug reports etc. at https://github.com/tobilg/sql-workbench/issues https://github.com/tobilg/sql-workbench/issues Thanks!
- mritchie712 3y ago
  SQL workbench also uses https://perspective.finos.org/ https://perspective.finos.org/ for tables. It's a WASM table library which pairs nicely with duckdb and works well with large tables.
ramonverse 3y ago
Cool stuff, we are also building in the space, currently adding Python support with Pyodide. I would recommend you add your live website at the top of the README so people can find it easily (we had a lot of views that way for https://github.com/pretzelai/pretzelai https://github.com/pretzelai/pretzelai). Also, we added a simple text2sql "Ask AI" that users loved, maybe your users will like it too.
- westurner 3y ago
  JupyterLite is also built on Pyodide. Is there support for DuckDB in JupyterLite in WASM in WhatTheDuck or pretzelai? datasette-lite can load [remote] sqlite and Parquet but not yet DuckDB (?) with Pyodide in WASM, and there's also JupyterLite as a datasette plug-in: https://github.com/simonw/datasette-lite https://github.com/simonw/datasette-lite
spxneo 3y ago
now how to make this collaborative? that would be interesting
18chetanpatel 3y ago
How about incorporating options for data visualization through charts?
- pratik227 3y ago
  Yah I think it's a good idea I think detailed documentation will also be helpful

119 points by slake 3y ago

WhatTheDuck is an in-browser sql tool to analyze csv files that uses duckdb-wasm under the hood. Please provide feedback/issues/pull requests.

yogini 3y ago

Loved the idea and the entire project! Starred it on GitHub. One suggestion, when I land on the website I would love to see a small example already added. Basic CSV and some SQL queries to run and play with. It would be best if you also launch it on Peerlist. Many people are working in a similar space there, they also might find this useful.

refset 3y ago

Looks nice! I would suggest to pointing users to a small demo csv file and query that can be quickly loaded/pasted to see it working. Or even have a "Load example CSV and query" button.

pratik227 3y ago
We have added an upload sample file button thanks for feedback @refset
slake 3y ago
Sounds like a good idea. We'll get to it.

boiler_up800 3y ago

IDE support is definitely one area where DuckDB could be better. My current workflow is to edit SQL files in VS Code and then use ‘.read’ within the DuckDB CLI.

fastasucan 3y ago
Same here. You have Harlequin which is worth a try, but ideally I would just write and execute in vscode.
reportgunner 3y ago
I don't use DuckDB but I use the community version of DBeaver for SQL - looks like it supports DuckDB too[0] [0] https://duckdb.org/docs/guides/sql_editors/dbeaver.html https://duckdb.org/docs/guides/sql_editors/dbeaver.html
chrisjc 3y ago
Keep an eye on this link. New support is being added every so often. https://github.com/davidgasquez/awesome-duckdb?tab=readme-ov-file#sql-clients-and-ide-that-support-duckdb https://github.com/davidgasquez/awesome-duckdb?tab=readme-ov...
- pratik227 3y ago
  Yes we have added there as well the PR is merged

hantusk 3y ago

I liked SQL workbench (https://news.ycombinator.com/item?id=39537794 https://news.ycombinator.com/item?id=39537794) which has the same core ideas but more usable features at this point (query history, parquet support and charts) - if you hadn't seen it maybe some of its features will inspire you.

tobilg 3y ago
Thanks you, https://sql-workbench.com https://sql-workbench.com author here :-) Let me know if you have some feature requests / bug reports etc. at https://github.com/tobilg/sql-workbench/issues https://github.com/tobilg/sql-workbench/issues Thanks!
mritchie712 3y ago
SQL workbench also uses https://perspective.finos.org/ https://perspective.finos.org/ for tables. It's a WASM table library which pairs nicely with duckdb and works well with large tables.

ramonverse 3y ago

Cool stuff, we are also building in the space, currently adding Python support with Pyodide. I would recommend you add your live website at the top of the README so people can find it easily (we had a lot of views that way for https://github.com/pretzelai/pretzelai https://github.com/pretzelai/pretzelai). Also, we added a simple text2sql "Ask AI" that users loved, maybe your users will like it too.

westurner 3y ago
JupyterLite is also built on Pyodide. Is there support for DuckDB in JupyterLite in WASM in WhatTheDuck or pretzelai? datasette-lite can load [remote] sqlite and Parquet but not yet DuckDB (?) with Pyodide in WASM, and there's also JupyterLite as a datasette plug-in: https://github.com/simonw/datasette-lite https://github.com/simonw/datasette-lite

spxneo 3y ago

now how to make this collaborative? that would be interesting

18chetanpatel 3y ago

How about incorporating options for data visualization through charts?

pratik227 3y ago
Yah I think it's a good idea I think detailed documentation will also be helpful