3 ms·
Looks very cool so far, congratulations! I have two questions: - How do you handle incremental loads from files (or even google sheets)? Am I able to only loa
by 2mol 6y ago
Looks very cool so far, congratulations!
I have two questions:
- How do you handle incremental loads from files (or even google sheets)? Am I able to only load the diff, load full snapshots and get bi-temporality, etc?
- Are you supporting PostgREST as sponsors in any way? It's one of the most solid tools I've ever used, and I love to see that companies build great products on top of it!
- ayazhan 6y ago- we use pandas to process data and load it to Postgres using .to_sql (https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.DataFrame.to_sql.html https://pandas.pydata.org/pandas-docs/stable/reference/api/p...). for incremental loads, we set "if_exists" to "append". we're working to add more flexibility to load function, so you can specify how to load your data, handle conflicts, and so on. we're open for suggestions - PostgREST is great. We are not sponsors at the moment, but looking to do this when we can!