2 ms·
> Goals for LLM development were set for the personified attributes, and not the actual functionally of the real thing. Well, this is for honest reasons. The g
by marcosdumay 4y ago
> Goals for LLM development were set for the personified attributes, and not the actual functionally of the real thing.
Well, this is for honest reasons. The goal of a chatbox is to beat the Turing test. It has always been.
Those chatboxes didn't actually beat it, but it's clear that it's due to a technicality (they are easy to spot). They can do empty chats on the same level as a human.
(And so it turns up that the test wasn't as useful as it was believed to be at first.)
- thomastjeffery 4y agoThe problem is when you loop that logic around: it becomes circular reasoning. What is the true source of an improved SAT score? If it's a person we are talking about, then it's an understanding of the subjects being tested. If it's an LLM, then it's...complicated. It might be because the training corpus provided more matching text. It might be because the training corpus provided text patterns that aligned better to the patterns in the SAT's text. The structure of phrases is just as important as the context they contain. It might be because the training corpus had fewer text patterns that result in "a wrong answer". Improving any of these means degrading the others. Logic is never involved. Symbolic reference, like defining words or "plugging numbers in" in to mathematical formula, is never involved. Doing well on one test does not mean doing well on a slightly rephrased version of that test.