Standard MLPs already capture this kind of non-linear relation. The huge impact of RNs, it seems, is in how it organizes the computation of these relations in

Standard MLPs already capture this kind of non-linear relation. The huge impact of RNs, it seems, is in how it organizes the computation of these relations in a more elegant/efficient way (object pairwise, rather than all at once)