Read the paper, it's quite short and sweet (though NN papers do have a lot of subscripts and superscipts) Basically yes, it was known that we can always do thi

Read the paper, it's quite short and sweet (though NN papers do have a lot of subscripts and superscipts) Basically yes, it was known that we can always do this. But apparently until now no one gave an algorithm to do so. I think it would probably be difficult to come up with a similar algo for sofmax