4 ms·
Well, MLPs is the actual neural network (the approximator), whereas the attention (the rest) is more of a text to relevant embedding extractor
by eurekin 3y ago
Well, MLPs is the actual neural network (the approximator), whereas the attention (the rest) is more of a text to relevant embedding extractor