3 ms·
All of what you described can change wildly from model to model. Even across different versions of the same model. Maybe a database could be built with “tells”
by dartos 2y ago
All of what you described can change wildly from model to model. Even across different versions of the same model.
Maybe a database could be built with “tells” organized by model.
- liontwist 2y agoExactly. Fixing the old tells just means there are new ones.
- handfuloflight 2y ago> Maybe a database could be built with “tells” organized by model. Automated by the LLMs themselves.
- dartos 2y agoNo thanks, I’d like it to be accurate ;) Regular ol tests would do
- handfuloflight 2y agoI should have been more precise. I meant the LLMs would output their tells for you, naturally. But that's obvious.
- dartos 2y agoThey can’t know their own tells… that’s not how any of this works. Thinking about it a bit more, the tells that work might depend on the usage of other specific prompts.
- handfuloflight 2y agoNot sure why you default to an uncharitable mode in understanding what I am trying to say. I didn't say they know their own tells. I said they naturally output them for you. Maybe the obvious is so obvious I don't need to comment on it. Meaning this whole "tells analysis" would necessarily rely on synthetic data sets.