2 ms·
Cool! I'm working on something on the other side of the same pipeline. Real time data ingestion and identity resolution, delivering into a data lake. Have you
by t0mas88 3y ago
Cool! I'm working on something on the other side of the same pipeline. Real time data ingestion and identity resolution, delivering into a data lake.
Have you considered adding source connectors for S3 based data lakes? For example Parquet files or Delta Lake? Maybe via AWS Athena to make it similar to the Red Shift connector?
- nagstler 3y agoYes! S3 as source connector is in our roadmap. Should be out soon. By connecting to S3 as a source & using Athena, data models can be created & synced to various business apps. Files in Parquet format is supported through Athena.
- nagstler 3y agoYou can raise an issue, explaining your use-case. Below is the link to roadmap for S3 as source connector. https://github.com/orgs/Multiwoven/projects/4/views/1?pane=issue&itemId=55141411 https://github.com/orgs/Multiwoven/projects/4/views/1?pane=i...