3 ms·
It's not strictly a question of trying Everything and seeing what sticks. There's a hypothesis in the parent comment - better handling of the time domain will
by sdenton4 4y ago
It's not strictly a question of trying Everything and seeing what sticks.
There's a hypothesis in the parent comment - better handling of the time domain will lead to better modeling - which is actually fairly independent of architecture. So, there's going to be a number of possible ways to build better time modeling, ranging from tweaks to existing architecture to completely rebuilding Rome. So, if better time modeling really is a limitation, you don't need to rebuild Rome to find out.
In fact, I might argue that S4 layers already provide this improved time handling in the current world, and is proving very successful, which would again widen the moat for SNNs.