4 ms·
GPT-3 seems to be a very good static search engine. I wouldn't be surprised if it gave better answers than Google on some/most generic queries. However, I wond
by blueblisters 6y ago
GPT-3 seems to be a very good static search engine. I wouldn't be surprised if it gave better answers than Google on some/most generic queries.
However, I wonder if there's an architecture that can learn new information without doing an explicit gradient descent/backward-pass. Most active learning seems to be some sort of fine-tuning.