5 ms·
The attention mechanism corresponds to the Hopf algebraic convolution, a generalization of the commonly known convolution. I'm in the process of implementing a
by adamnemecek 3y ago
The attention mechanism corresponds to the Hopf algebraic convolution, a generalization of the commonly known convolution.
I'm in the process of implementing a framework based on this idea.
I have written a paper on this recently, https://arxiv.org/abs/2302.01834 https://arxiv.org/abs/2302.01834
I have a discord channel https://discord.cofunctional.ai https://discord.cofunctional.ai.
- capableweb 3y agoYou never just work on something until it's being ready to be shared, and then share it once? It has to be shared before it's even a little bit usable, with just some vague words about what it might be?
- adamnemecek 3y agoI'm gauging interest and looking for potential users. Steve Blank and all that.
- verdverm 3y agoThe first step to crossing the chasm is finding those innovators and learning if you are solving a problem!
- adamnemecek 3y agoI have and I am. Next.