3 ms·
You can process a single word through a transformer and get the corresponding intermediate representations. Though it sounds odd there is no problem with it an
by navar 1y ago
You can process a single word through a transformer and get the corresponding intermediate representations.
Though it sounds odd there is no problem with it and it would indeed return the model's representation of that single word as seen by the model without any additional context.