4 ms·
I took the text of Macbeth and changed the dialect of one line: Original: "The rest, that are within the note of expectation, alreadie are i'th' Court" New: "
by panarky 3y ago
I took the text of Macbeth and changed the dialect of one line:
Original: "The rest, that are within the note of expectation, alreadie are i'th' Court"
New: "It looks like everyone is here already"
Then I gave the entire text to Gemini, ~400000 tokens, and asked it to analyze the play's diction and style, and to identify any lines that didn't match the prevailing dialect.
It found that one line I'd changed.
- interstice 3y agoIsn’t it quite likely it already had the whole text from its training data? Which might make it a bit of a different case.
- panarky 3y agoI was responding to the assertion that the "ability to compare within-context dramatically declines with large context". My test demonstrates that even with a large context, Gemini 1.5 finds the needle in the haystack. And it's not even searching for specific terms or meanings, the only clues are subtle differences in style and diction.