Droppath is a regularisation technique that uses one of those insights. I wonder if the other insights can also be turned into regularisation methods. Like rand

Droppath is a regularisation technique that uses one of those insights. I wonder if the other insights can also be turned into regularisation methods. Like randomly shuffling layers or executing random batches of layers in parallel.