Designing Data Intensive Applications is a good read, especially if you’re interested in the “programming in the large” aspect of data engineering [1]. It does

Designing Data Intensive Applications is a good read, especially if you’re interested in the “programming in the large” aspect of data engineering [1]. It does have a slightly theoretical taste to it, but I think you’ll find that helpful since some of the problems you listed don’t really have a good solution at the moment (versioning a model, for example). [1] http://dataintensive.net http://dataintensive.net