2 ms·
I think your comment shows more a lack of imagination than anything. For example, the latest use discussed in the OA Slack is someone is using it to construct
by gwern 6y ago
I think your comment shows more a lack of imagination than anything.
For example, the latest use discussed in the OA Slack is someone is using it to construct a high-quality index for a book they are making. You just feed GPT-3 a few example paragraphs/keyword pairs to few-shot keywords, and then feed all the other paragraphs into it. Now you have constructed an index; as they put it, it's 90% of the quality of a human indexer, at 0% of the cost (and less than months of painstaking labor).
Could you have done that with BERT or something? Maybe. Presumably there are NLP datasets which you could finetune keyword extraction on... But GPT-3 lets you get started after a few minutes of tinkering. The hardest part is integrating it into your LaTeX!
- api 6y agoYou see a lack of imagination. I see naïveté. I will rephrase: I see negative applications being the ones with the highest impact. 90% the quality of a human indexer is not that great. Who's going to pay for that? But spam that can't be filtered and automated con artistry at scale? Fraudsters, shady black hat advertisers, political parties, and shady governments will pay millions to billions for a tool like that. Con artistry at scale is the one I find absolutely terrifying. Imagine spam bots that engage with you, that make friends with you... We could be talking about the hydrogen bomb of propaganda. I find those scenarios much scarier than "runaway super-intelligence" type AI takeover stuff because they are significantly more plausible. We can almost do what I'm imagining today. It's not science fiction. There is no question of its feasibility.