3 ms·
Kind of, but that's not inherent to the over reliance on memorization. I suspect using the top tier models from any of OAI, Anthropic, or Google would have resu
by scarmig 2y ago
Kind of, but that's not inherent to the over reliance on memorization. I suspect using the top tier models from any of OAI, Anthropic, or Google would have resulted in much less embarrassing results, and I believe they're all primarily memorizers, not generalizers.
The search issue happened because Google had to use a really cheap model to power the search results, and a memorizing model that cheap is going to be highly constrained in capabilities (at least right now).
- chaorace 2y agoIt doesn't help that they were caught with their pants down back when GPT-3 first entered the zeitgeist (and thus also the radar of Google's institutional stakeholders). Haste made waste, corners got cut, cargo went overboard.