3 ms·
> I'd like to see one that is solving the mystery in a mystery book right before it's revealed. I would think this is a not so good bench. Author does not writ
by latency-guy2 2y ago
> I'd like to see one that is solving the mystery in a mystery book right before it's revealed.
I would think this is a not so good bench. Author does not write logically, they write for entertainment.
- adamgordonbell 2y agoSo I'm thinking of something like Locked-room mystery where the idea is it's solvable, and the reader is given a chance to solve. The reason it seems like an interesting bench, is it's a puzzle presented in a long context. Its like testing if an LLm is at Sherlock Holmes level of world and motivation modelling.