Not super strange if you think of it going the other way. Think of a saddle like construct, in one dimension you get stuck easily, in another tgere is a way for

Not super strange if you think of it going the other way. Think of a saddle like construct, in one dimension you get stuck easily, in another tgere is a way forward where over time the other previously 'stuck' dimension is freed up again. In higher dimensions you have a much higher chance of havibg such alternative pathways. During training this looks lime breif plateaus in loss reduction followed by a sudden rapid decrease again. Sorry for typos, bumpy train, fix one get another, will try edit later.