2 ms·
Congrats on your project. Reliable CDC is hard to set up. I worked a bit on the space, focusing on api instead of DB, which is in the end a quite different pro
by BenderV 3y ago
Congrats on your project. Reliable CDC is hard to set up.
I worked a bit on the space, focusing on api instead of DB, which is in the end a quite different problem.
My goal was to leverage LLM to auto-build connector on the fly.
I started by building a lightweight ETL, that I open-sourced (https://github.com/BenderV/universal-data https://github.com/BenderV/universal-data).
I left the space because I realize that I didn't want to work on this problem, even though I believe in the "AI" approach, and think simplifying data transfer (or distributing compute) is one the key factor to scale data usage.