these are largely solved by data lake vendors: Snowflake, Databricks and alike. an experienced databricks/snowflake architect (or a couple of them) can easily

these are largely solved by data lake vendors: Snowflake, Databricks and alike. an experienced databricks/snowflake architect (or a couple of them) can easily set up and maintain data lake that supports most of what was mentioned. Overall I absolutely agree, that rather than learning python or SQL, it is much better use of one's time to learn/get certified as Data Lake Architect and be able to create a large data lake from scratch and set up pipelines and maintain them.