4 ms·
Can someone please answer: Which layer is best used for similarity search? The initial input embedding? Input embedding after positional encoding is added? The
by stormfather 3y ago
Can someone please answer: Which layer is best used for similarity search? The initial input embedding? Input embedding after positional encoding is added? The output layer? Some hidden layer? It's not clear to me why one would be better than the other.