4 ms·
Pgwarehouse: Easily sync your Postgres db to a Snowflake or ClickHouse warehouse
- scottpersinger 4y agoBuilt this recently to help a friend setup a Snowflake warehouse from their Postgres database. Also tested it with ClickHouse which is cool for running locally. Uses simple COPY which is fast and doesn't require binlog access, but doesn't support real-time replication as a result.
- tylerhannan 4y agoSuper interesting, I look forward to playing with it. FWIW, the Community Integrations section of https://clickhouse.com/docs/en/integrations https://clickhouse.com/docs/en/integrations is open for PRs if you want to add it ;)
- scottpersinger 4y agocool - will do!
- higeorge13 4y agoInteresting tool! I am curious about this feature: https://github.com/scottpersinger/pgwarehouse#last-modified https://github.com/scottpersinger/pgwarehouse#last-modified in Clickhouse. Have you tested it on big tables and how well does it perform?