3 ms·
> approximate any continuous function It wouldn't surprise me if many interesting functions we'd like to approximate aren't continuous at all.
by quikoa 7mo ago
> approximate any continuous function
It wouldn't surprise me if many interesting functions we'd like to approximate aren't continuous at all.
- thesz 7mo agoThis is what softmax [1] is for. [1] https://en.wikipedia.org/wiki/Softmax_function https://en.wikipedia.org/wiki/Softmax_function
- jandrewrogers 7mo agoThis is one of the reasons current AI tech is so poor at learning physical world dynamics. Relationships in the physical world are sparse, metastable graphs with non-linear dynamics at every resolution. And then we measure these dynamics using sparse, irregular sampling with a high noise floor. It is just about the worst possible data model for conventional AI stacks at a theoretical level.