3 ms·
This is very cool!. Last time I checked duckdb didn't have the concept of a metastore so do you have an internal convention for table locations and folder str
by quadrature 3y ago
This is very cool!.
Last time I checked duckdb didn't have the concept of a metastore so do you have
an internal convention for table locations and folder structure ?.
What do you use for reports/visualizations? notebooks ?.
- zlurker 3y agoYeah, dagster has a concept of metadata and assets so we have some code that'll map dagster's own logical representation to physical s3 locations. Reports and viz varies a lot, the finance department uses tableau where as for more 'data sciencey' stuff we normally just use notebooks.
- quadrature 3y agoHadn't heard of that dagster feature, thats really cool.