4 ms·
IQ is a discovery about how intelligence occurs in humans. As you mentioned, a single factor explains most of the performance of a human on an IQ test, and tha
by alphazard 1y ago
IQ is a discovery about how intelligence occurs in humans. As you mentioned, a single factor explains most of the performance of a human on an IQ test, and that model is better than theories of multiple orthogonal intelligences. To contrast, 5 orthogonal factors are the best model we have for human personality.
The first question to ask is "do LLMs also have a general factor?". How much of an LLMs performance on an IQ test can be explained by a single positive correlation between all questions? I would expect LLMs to perform much better on memory tasks than anything else, and I wouldn't be surprised if that was holding up their scores. Is there a multi factor model that better explains LLM performance on these tests?
- naveen99 1y agoSome points on the 4 ? or 5 dimensional personality space correlate with higher iq though.
- alphazard 1y agoThat may be the case. The personality traits are mostly uncorrelated with one another. I was trying to give an example of what a successful multi factor model looks like (the Big 5) to then contrast it with a multi factor model that doesn't work well (theories of multiple intelligences).
- famouswaffles 1y ago>The first question to ask is "do LLMs also have a general factor?". Yes, there is some research about it here - https://www.sciencedirect.com/science/article/pii/S0160289624000527 https://www.sciencedirect.com/science/article/pii/S016028962...