3 ms·
That is an incredibly accurate answer for a niche question (about the best fantasy series of all time, but still less well known than Lord of the Rings so, nich
by lucubratory 3y ago
That is an incredibly accurate answer for a niche question (about the best fantasy series of all time, but still less well known than Lord of the Rings so, niche). How is Bard getting that so accurate? My first thought is that maybe they've had an LLM go over their books training corpus and pre-summarise every single book or series, then trained on those summaries as well. Or maybe they did some semi-automated Q/A generation using knowledge extracted from books using traditional techniques (vector search, instance count, first mentioned, etc) to evaluate answers to the model's responses on books.
That's actually really fascinating, I've consistently found that Bard underperforms GPT-4 but this is a resounding win. I wonder what makes this question so different.
- renewiltord 3y agoIt's wild! I'm sure they used the Google Books dataset