I really like this trend of large research group writing more about the difficulties they encountered along the way. Meta had also released a (much more detail

I really like this trend of large research group writing more about the difficulties they encountered along the way. Meta had also released a (much more detailed) "Logbook" when they published their 175b models in May: https://github.com/facebookresearch/metaseq/blob/main/projects/OPT/chronicles/OPT175B_Logbook.pdf https://github.com/facebookresearch/metaseq/blob/main/projec... For example I somehow expected a Chinese research group with such a proven track record to be showered in compute by the government...