3 ms·
An unexpected application of feistel network is for creating neural networks that are invertible! https://arxiv.org/abs/1802.07088 https://arxiv.org/abs/1802.0
by fyp 7y ago
An unexpected application of feistel network is for creating neural networks that are invertible!
https://arxiv.org/abs/1802.07088 https://arxiv.org/abs/1802.07088
- fvncc 7y agoAnother example is RealNVP, which has the same structure to enable inversion (partition, process half, then use the result to mutate the other half in an invertible way). Sadly, I gather the computational performance Is pretty bad .. https://arxiv.org/abs/1605.08803 https://arxiv.org/abs/1605.08803
- visarga 6y agoInteresting, I was aware of this technique in deep learning but didn't know its origin!