this is the "universal approximator theorem". https://cognitivemedium.com/magic_paper/assets/Hornik.pdf https://cognitivemedium.com/magic_paper/assets/Hornik.p

this is the "universal approximator theorem". https://cognitivemedium.com/magic_paper/assets/Hornik.pdf https://cognitivemedium.com/magic_paper/assets/Hornik.pdf > infinite number of [activations] I don't think you need an infinite number of them, there is a relationship between "how close you want to get" and "how many of them you need".