3 ms·
Mainly the model. People tend to talk about extreme things more than less extreme things - so if a PC questionnaire came back saying "You're more liberal than
by munk-a 3y ago
Mainly the model. People tend to talk about extreme things more than less extreme things - so if a PC questionnaire came back saying "You're more liberal than Bernie Sanders" the person is more likely to tweet about it than the questionnaire saying "You're as liberal as Lyndon B. Johnson". Additionally - having the LLM trained on a set containing output from a test has got to mess with its ability to be neutrally trained on that specific test - it's much more likely to answer in a manner that is tailored specifically to that test which would remove a lot of nuance.