3 ms·

Here's "generative pretaining" in an IEEE publication from 2012. https://www.cs.toronto.edu/~hinton/absps/DNN-2012-proof.pdf https://www.cs.toronto.edu/~hinton/

Here's "generative pretaining" in an IEEE publication from 2012. https://www.cs.toronto.edu/~hinton/absps/DNN-2012-proof.pdf https://www.cs.toronto.edu/~hinton/absps/DNN-2012-proof.pdf Geoffrey Hinton wrote it. I wonder if he'll have anything to say about OpenAI trademarking the term 11 years after he wrote this. Here's an earlier publication from January, 2012 talking about Hinton's 2011 "Generative pretraining" work: https://www.microsoft.com/en-us/research/publication/three-classes-of-deep-learning-architectures-and-their-applications-a-tutorial-survey/ https://www.microsoft.com/en-us/research/publication/three-c...

hn_throwaway_99 4y ago
> Geoffrey Hinton wrote it. I wonder if he'll have anything to say about OpenAI trademarking the term 11 years after he wrote this. But they're not applying to trademark "generative pretraining". They're only applying to trademark GPT, which seems (I have very limited knowledge if there are other competing uses of the term) reasonable given that most people associate "GPT" with specific AI implementations created by OpenAI. There were other "business machine" companies that existed 100 years ago, but that is very different from trademarking "IBM".