This is because your question is an infrastructure question, not a data engineering question. Sure it would be better if the engineers knew about infrastructur

This is because your question is an infrastructure question, not a data engineering question. Sure it would be better if the engineers knew about infrastructure, but they don't have to know about it. And honestly, the weeds of physical data transfer between computers is actually very complex, and I think data engineers should leave it to the pros rather than screwing around trying some stuff that's guaranteed to fail either regarding security, performance or caching. Data engineers should know about how to deal with data content, not data transport. If that's what your role is about, you should re-brand it.