4 ms·

Thank you for giving this a spin. That's correct, today you'd need to drop the table before another sync with pg_flo. That said, I have given delta syncs some t

Thank you for giving this a spin. That's correct, today you'd need to drop the table before another sync with pg_flo. That said, I have given delta syncs some thought, and also looking into a control plane that can make some of these things easier. Would love to hear your feedback.

shayonj 2y ago
I think this also might be of interest to you - just one time copies and apply transformations - https://github.com/shayonj/pg_flo/issues/6 https://github.com/shayonj/pg_flo/issues/6. I will look into shipping that very soon.
- rileymichael 2y ago
  Oh awesome, yeah that’d work perfect then. I’d just prep beforehand and run the one-time copy.
  - shayonj 2y ago
    amazing! Will plan a release by Tuesday latest. You can experiment with `--copy-and-stream ` in the meantime [1] [1] https://github.com/shayonj/pg_flo?tab=readme-ov-file#streaming-modes https://github.com/shayonj/pg_flo?tab=readme-ov-file#streami...
  - shayonj 2y ago
    Heya! v0.0.4 is now out with `--copy` support, which will stream all the data from the table and the transformation/routing will get applied before the changes land in destination. [1] https://github.com/shayonj/pg_flo?tab=readme-ov-file#streaming-modes https://github.com/shayonj/pg_flo?tab=readme-ov-file#streami... [2] https://github.com/shayonj/pg_flo/releases https://github.com/shayonj/pg_flo/releases
    - rileymichael 2y ago
      Awesome turn around — I’ll give it a go this week!