4 ms·
I wrote an ETL thing recently based on generators. It's quite similar in concept to the paper[1] that David Beazley wrote (without ever hearing about the paper
by nakkiel 15y ago
I wrote an ETL thing recently based on generators. It's quite similar in concept to the paper[1] that David Beazley wrote (without ever hearing about the paper though). Source's available at https://bitbucket.org/saalaa/sauceboat https://bitbucket.org/saalaa/sauceboat
When I'll have time, I'll implement a web WSGI Web UI to provide visualization capability. My goal is to provide a programmer-friendly replacement to Pentaho Kettle.
[1] http://www.dabeaz.com/generators/Generators.pdf http://www.dabeaz.com/generators/Generators.pdf
- oscilloscope 15y agoI'd like to hear more about this. I'm working on a javascript CSV reader that displays parallel coordinates + a data grid: http://exposedata.com/parallel/upload.html http://exposedata.com/parallel/upload.html http://exposedata.com/parallel/ http://exposedata.com/parallel/ (if upload fails, this is what it looks like) Once I get the CSV uploader more robust, I'll add additional charts that respond to interactive filters/aggregators, just as the table responds to the chart above. The goal is a data exploration tool for non-programmers, but I'm keen to extend it for programmers who need more sophisticated ETL and are willing to do a little scripting.
- nakkiel 15y agoI'm not sure you should provide ETL capabilities.. Usually, ETL and visualization are separate steps in the workflow and sometimes even in a team. If it's too limited in scope it won't be very useful anyway.