3 ms·
To clarify for people familiar with the names but not what corresponds to what: BERT - Encoder-only - embeddings for downstream tasks GPT/OPT/etc - Decoder-on
by amilios 3y ago
To clarify for people familiar with the names but not what corresponds to what:
BERT - Encoder-only - embeddings for downstream tasks
GPT/OPT/etc - Decoder-only - language generation
T5/T0 - Encoder-decoder. Kind of does both?