3 ms·
Were transformers used in other contexts ? biochemistry ? geometry .. whatever.
by agumonkey 4y ago
Were transformers used in other contexts ? biochemistry ? geometry .. whatever.
- skinner_ 4y agoAlphafold uses something they call Evoformer, it is an attention mechanism. Our group has tried, and so far failed to utilize transformers for a very very specific search problem in geometry (https://bit.ly/unit-distances https://bit.ly/unit-distances).
- agumonkey 4y agothanks a lot man, very nice