4 ms·
There's an open question if GPT-3 simply provides a text completion API for the internet. The original paper discusses the risk that datasets for specific eval
by lumost 6y ago
There's an open question if GPT-3 simply provides a text completion API for the internet. The original paper discusses the risk that datasets for specific evaluation tasks (or equivalents) were simply memorized by the model.
A completion API for the internet could still be an incredibly valuable component.
- fock 6y agoyes! if a thing of similar performance as GPT-3 could just spew out links to where its "inspiration" comes from, this would be (super expensive?) real context-aware search. This could be really great.