3 ms·
I don't have explanations but I can point you to one of the papers: https://arxiv.org/pdf/2309.12288 https://arxiv.org/pdf/2309.12288 which calls it "the revers
by michaelt 2y ago
I don't have explanations but I can point you to one of the papers: https://arxiv.org/pdf/2309.12288 https://arxiv.org/pdf/2309.12288 which calls it "the reversal curse" and does a bunch of experiments showing models that are successful at questions like "Who is Tom Cruise’s mother?" (Mary Lee Pfeiffer) will not be equally successful at answering "Who is Mary Lee Pfeiffer’s son?"
- spookie 2y agoIsn't that specific case just a matter of not having enough data _explicitly_ stating the reverse? Seems as if they are indeed stochastic parrots from that perspective.