This is not really a great analysis. I would like to see an analysis from someone who: -Is actually familiar with academic code so that the usual pearl clutchi

This is not really a great analysis. I would like to see an analysis from someone who: -Is actually familiar with academic code so that the usual pearl clutching can be tempered with realism. That doesn't mean throwing up one's hands and just accepting that all academic code is like this, but it does mean coming from a place of knowing what normal academic code looks like (much worse than this). -Is actually familiar with production forecasting in other contexts (outside of the small bubble of SV) the writer says they have "done some model review of financial models". I have done a lot of such reviews and many models are implemented in idiosyncratic Excel. Yes, models that drive policy decisions in government and large transactions in finance, models that are used in internal forecasting in many places. All Excel. A recognition of the difference between should and is. There are claims here about what should be done in modelling which are correct but with little recognition that they almost never are. Really I would like to see a review by someone who is familiar enough with epi modelling and with modern software engineering practices to give a balanced assessment. The only material criticism of the model that isn't just "this should have been implemented better" is that it assumes that people will not voluntarily implement forms of social distancing when many people are dying and that this distorts upwards the death count. An agent based model would model people's time varying contact matrices based on what they can observe (so as death rates go up, voluntary social distancing goes up as well). Presumably this leads to a higher peak than mandatory measures because deaths lag measures which are visible to policy makers but not to the public, therefore people will distance later. This is indeed not addressed in the model. It could be addressed exogenously by making interactions dependent on the rolling average death count of the last several days as that is probably the signal that will the cause the most widespread panic. However. There is some important context here which is that: -This was not even the only model used by SAGE. The LSHTM model was run alongside it and gave similar results. -The "no intervention" case was sense checked using the basic equations of epidemiology. Models that drive decisions can be criticised on technical-procedural grounds (ideally this model should use fewer globals, and use psuedorandomness better so that it gives the exact same result on every run rather than more-or-less the same result on every run) and on model concept basis (the model assumes zombies) but the most important assessment of real models is how they drive decisions. In that regard the model was successful and drove the same decision as the very different LSHTM model, the models used by almost every other country, and what could be estimated using Epi 101. That is the necessity of mass social distancing. Even the Swedes, incidentally, accept this. They have chosen to make everything except for the closure of the highest risk establishments voluntary. I wonder though if isn't the case that these restrictions are in practice voluntary in many cases even in the UK. I could easily visit my family and friends - the police would never know. My employer could continue having us come into work - there is no absolute ban on office workers being required to come in, just guidance that people who can work from home should. The actual legislation can be considered not only as enforceable rules but also as high-cost signalling. There will be people who simply will not take it seriously otherwise on the grounds that "if it were really that bad, they would ban it" So to come back to the one substantive criticism - what different advice would a model that implemented behaviour changes have led to? I don't think it would have changed anything, if you tell policymakers: "listen, we don't necessarily need to make these things mandatory, once the coffins pile up people will stay home by themselves" what do you think that is going to drive? They're hardly likely to decide that we can leave off the restrictions. We came up to 80% or so of ICU capacity as it was. That tells me that anything that led to less or later social distancing would have put us in the position that Bergamo or Madrid were - at least localised and temporary overwhelming of hospitals. Potentially much worse.