Sounds like you're mostly interested in provenance and lineage. Pandas doesn't really help with that and I haven't seen any serious efforts to build on top of p

Sounds like you're mostly interested in provenance and lineage. Pandas doesn't really help with that and I haven't seen any serious efforts to build on top of pandas for it. If you want to roll code, you could use decorators or overload pandas methods like joins to build a provenance graph. If you don't want to roll code, you can treat the transform as a black box and define your inputs and outputs in terms of database/store tables.