> The field of ML research is moving so fast that people don’t even take time anymore to explain the design decisions behind their architectures Often, they do

> The field of ML research is moving so fast that people don’t even take time anymore to explain the design decisions behind their architectures Often, they don't fully understand why certain methods work, they simply experiment and observe the outcomes. This sentiment is echoed by one of the authors of the Transformer paper in another publication[1], where he states: "We offer no explanation as to why these architectures seem to work; we attribute their success, as with all else, to divine benevolence." [1] https://arxiv.org/pdf/2002.05202.pdf https://arxiv.org/pdf/2002.05202.pdf