3 ms·
The theorem you mention is true for networks whose widths tend towards infinity. This paper assumes a nn is given with fixed width n and fixed depth l. The mai
by orange3xchicken 7y ago
The theorem you mention is true for networks whose widths tend towards infinity.
This paper assumes a nn is given with fixed width n and fixed depth l. The main result is that there exists a subnetwork of a nn with depth 2l and width polynomial in n and l that can approximate it arbitrarily well.