A curious recent variations is allowing the number of hidden units to be infinite. It was observed that increasing number of hidden units in a two level percept

A curious recent variations is allowing the number of hidden units to be infinite. It was observed that increasing number of hidden units in a two level perceptron reduces the number of local minima encountered during training. Allowing the number of hidden units to be unbounded makes the optimization problem convex http://books.nips.cc/papers/files/nips18/NIPS2005_0583.pdf http://books.nips.cc/papers/files/nips18/NIPS2005_0583.pdf