WRT American pre-calculation and its relationship to software... One of the great personal epiphanies of my professional career was the discovery of data pre-c

WRT American pre-calculation and its relationship to software... One of the great personal epiphanies of my professional career was the discovery of data pre-computation FLOABW. More specifically, what I'm talking about is data denormalization. I had always been aware of caching techniques, but beyond that, data normalization was so ingrained into my mindset, that storing any piece of data that could otherwise be derived from another seemed like heresy, something only an amateur or fool would do. What really opened my eyes, was when I was forced to build a social network atop MongoDB (ouch), and I had to resolve the incompatibility of relational data, but with atomic write, with no join or transactional support. What I discovered, was that if care was taken to create a canonical representation of the data, a multitude of query-able denormalized derived tables could be utilized, and could in fact offer dramatically superior performance compared to its RDBMS equivalent. What was especially shocking, was how obvious this was in retrospect and how blinded I was by the assumption that perfect data consistency was a requirement for all software. I now view most tasks with the consideration, "What would this look like if we ignored efficiency in favor of raw performance and might that be worth it?"