5 ms·
Isn't "Generative Pre-Trained Transformer" an obscure acronym that openai came up with though? I know openai didn't invent the transformer, but "Attention Is A
by michaelt 3y ago
Isn't "Generative Pre-Trained Transformer" an obscure acronym that openai came up with though?
I know openai didn't invent the transformer, but "Attention Is All You Need" is about translation, they don't mention the word "generative"
- quonn 3y agoBut that class of models has been known as generative for years even before the attention paper.
- ben_w 3y agoI think that's a weak reason to deny a trademark, given WIMP interfaces were well known before MS Windows.
- bhickey 3y ago> Isn't "Generative Pre-Trained Transformer" an obscure acronym that openai came up with though? Nope, they didn't coin the acronym. First appearance of OpenAI GPT was in the BERT paper by Devlin et al. 2018.
- deleted 3y ago[deleted]
- littlestymaar 3y agoYep, and had they applied for a trademark back then, it would very likely have been granted. Like Apple didn't wait the iPhone 4 to trademark the iPhone brand… But now the term has been used colloquially for years, so it's out of reach of trademark protect at this point.