6 ms·

What every paper I have seen so far is missing is that there are many ways to achieve super-human intelligence. (I need to give creidt to Isaac Arthur of SFIA f

What every paper I have seen so far is missing is that there are many ways to achieve super-human intelligence. (I need to give creidt to Isaac Arthur of SFIA for this.) Getting results faster is one way. AIs beat me in speed. Getting results cheaper is another way. AI is cheaper than I am. Knowledge across many fields is better. AI beats me here too. Getting better results in one narrow field is another way, but only one of many ways. I love evaluations of human produced work vs. machine produced work. If we had quality evaluations (not the type-oh riddled garbage most people use.) If we compared AIs to people who work in those fields in occupations recognized by the US Dept of Labor. If we asked both sides to justify their answers. If we had statistically significant sample sizes. Then maybe we could get some good results on quality of work. I can imagine the US DOL spending billions if dollars benchmarking AIs against humans i all the occupations the recognize. Alternately, this could be a very profitable company.

jacquesm 3y ago
That's why the 'G' in AGI is so important.
varispeed 3y ago
I view LLM as a search engine, that can find and present the knowledge in a way that is easier to consume. For instance: Find me a solution to 2x2. I see this as a search problem, not reasoning problem. I think many scientists don't look at it from this angle and push the agenda that somehow current AI can reason. It can't. It's just a search engine / pattern matching contraption that works so well it can fool people into thinking they interact with an intelligence. Frankly, many people "think" in the same way. They store facts in their brain and then retrieve them when asked, but they have limited ability to arrive at new facts from those they already know, without external input. In that sense, the "AI" can certainly replace humans in tasks that don't require to think or where there is a need to distil information from a wide array of sources in a useful way.
- ben_w 3y ago
  I see it as translation, not search. Search is already done fantastically well at small scale with simple indexing, and (before adversarial reactions from SEO) at internet scale with Page rank. Asking if LLMs are really reasoning or not feels like an argument about terminology, like asking if A* really is route planning.
- prox 3y ago
  Having tried a week of LLM instead of search, the results are usually very good as a search engine goes (I used you.com that adds search results) But the amount of hallucinations was staggering. There is nothing behind the curtain so to speak. I constantly had to guide it like a little kid.
  - p1esk 3y ago
    Is you.com using gpt4?
    - prox 3y ago
      Sorry for the late reply, I think gpt4 is behind a paywall.
      - p1esk 3y ago
        Well, if you haven’t tried gpt4 you haven’t really experienced modern AI.
- gnaritas99 3y ago
  [dead]
- pixl97 3y ago
  The following is a logical reasoning problem. Determine which answer, A,B,C, or D is correct FXGB, HXIB, JXKB, _____, NXOB A. OXPBB. B. KXMBC. C. LXLBD. D. LXMB ChatGPT The pattern in the sequence "FXGB, HXIB, JXKB, _____, NXOB" suggests an alternating increment in the letters surrounding "X". Analyzing each component: The first letter sequence: F, H, J, __, N The pattern here is increasing by 2: F (+2) → H, H (+2) → J. Following this, J (+2) → L. So, the first letter of the missing term is L. The third letter sequence: G, I, K, __, O The pattern is the same as the first sequence: G (+2) → I, I (+2) → K. So, K (+2) → M. The third letter of the missing term is M. The last letter sequence: B, B, B, __, B The pattern is consistent: the letter B repeats. So, the last letter of the missing term is B. Combining these, the missing term is LXM(B). The answer is C. LXL(B)D. ---- Unfortunately I did not make up the question myself, so is it already in the training set?
  - root_axis 3y ago
    This response is actually quite illustrative of the stochastic nature of LLMs. Under normal circumstances a human would never make this kind of error. The system remains coherent long enough to produce the right answer, yet it still confidentially selects the wrong answer because it only understands the question as a function of statistical relationships between tokens, unlike humans who would understand the question at a conceptual level.
  - kenjackson 3y ago
    I asked the question on GPT 4 and got the right answer: To solve this logical reasoning problem, we need to look for patterns in the given sequence: FXGB, HXIB, JXKB, _____, NXOB. 1. Analyzing the first and last letters of each group: - FXGB → HXIB → JXKB → ? → NXOB - F → H → J → ? → N Here, the pattern in the first letter seems to be skipping one letter in the alphabet each time (F +2 → H, H +2 → J, J +2 → L). So, the first letter of the missing group should be L. Looking at the last letter, we see a similar pattern: - B → B → B → ? → B The last letter is consistently B, so the last letter of the missing group should also be B. 2. Now, for the middle letters: - FXGB → HXIB → JXKB → ? → NXOB The middle letter appears to be consistently 'X', and the next letter is incrementing by one each time (G → I → K → ? → O). Following this pattern, the letter after 'X' should be M (K +1 → L, L +1 → M). So, putting it all together, the sequence should be LXMB, which is option D. Therefore, the correct answer is D. LXMB.
usaar333 3y ago
Note that the goal of ASI isn't to beat you per se, but the best humans. GPT-4 is generally not competitive with domain specialists (outside areas where machines have already been competitive for some time). That of course doesn't mean it isn't valuable - but it becomes more for human augmentation than replacement.
- RecycledEle 3y ago
  ASI stands for Artificial Superintelligence.
  - godelski 3y ago
    > ASI stands for Artificial Superintelligence. >> Note that the goal of ASI isn't to beat you per se, but the best humans. I'm pretty sure they understand that.
    - RecycledEle 3y ago
      Before ASI can beat the best humans, it is going to wipe the floor with me. Maybe I'm selfish, but it's the time when my boss decides my worth that I'm concentrating on.
- RecycledEle 3y ago
  I don't see it as a dialectic. I see it as a continuum. There is value to replacing a percentage of human labor with machine labor. Jordan Peterson said there are no jobs in the USA for people with IQs below 87: https://www.youtube.com/watch?v=RN3w_F9r-aI&t=338s https://www.youtube.com/watch?v=RN3w_F9r-aI&t=338s Mr. Peterson says lower IQ people are do better at more repetitive jobs. Machines and AI can do more repetitive jobs. Technology took those jobs. As AI advances, the lowest useful IQ will move up. I wonder where it will be in 10 years.
  - deleted 3y ago
    [deleted]
  - 3y ago
greenthrow 3y ago
These are not "ways" of achieving superhuman intelligence, these are potential forms of superhuman performance. It's also a very broad definition, because by that definition we have had superhuman performance in computation for decades. And we've been able to write programs for very narrow tasks that outperform humans for that time as well. Generally when people are comparing artificial intelligence against human intelligence, they want an AGI. Humans aren't good at just one narrow thing, that's why they aren't all replaced by specialized programs already. We are taking about being able to describe a problem and the artificial intelligence can take it from there. That's why the bar is AGI, which is a much higher bar than any of your broad definitions.
- pixl97 3y ago
  Though I think we should take note that the write programs for very narrow tasks that outperform humans may start seeing widening. Things like object recognition have moved from "only humans can do this" to machines are keeping up with us. And I think that this is how it will be for at least some time. Instead of one big blast where ASI is better than humans at everything, more and more categories of narrow intelligence will widen and become superhuman.

jacquesm 3y ago

That's why the 'G' in AGI is so important.

varispeed 3y ago

I view LLM as a search engine, that can find and present the knowledge in a way that is easier to consume. For instance: Find me a solution to 2x2. I see this as a search problem, not reasoning problem. I think many scientists don't look at it from this angle and push the agenda that somehow current AI can reason. It can't. It's just a search engine / pattern matching contraption that works so well it can fool people into thinking they interact with an intelligence. Frankly, many people "think" in the same way. They store facts in their brain and then retrieve them when asked, but they have limited ability to arrive at new facts from those they already know, without external input. In that sense, the "AI" can certainly replace humans in tasks that don't require to think or where there is a need to distil information from a wide array of sources in a useful way.

ben_w 3y ago
I see it as translation, not search. Search is already done fantastically well at small scale with simple indexing, and (before adversarial reactions from SEO) at internet scale with Page rank. Asking if LLMs are really reasoning or not feels like an argument about terminology, like asking if A* really is route planning.
prox 3y ago
Having tried a week of LLM instead of search, the results are usually very good as a search engine goes (I used you.com that adds search results) But the amount of hallucinations was staggering. There is nothing behind the curtain so to speak. I constantly had to guide it like a little kid.
- p1esk 3y ago
  Is you.com using gpt4?
  - prox 3y ago
    Sorry for the late reply, I think gpt4 is behind a paywall.
    - p1esk 3y ago
      Well, if you haven’t tried gpt4 you haven’t really experienced modern AI.
gnaritas99 3y ago
[dead]
pixl97 3y ago
The following is a logical reasoning problem. Determine which answer, A,B,C, or D is correct FXGB, HXIB, JXKB, _____, NXOB A. OXPBB. B. KXMBC. C. LXLBD. D. LXMB ChatGPT The pattern in the sequence "FXGB, HXIB, JXKB, _____, NXOB" suggests an alternating increment in the letters surrounding "X". Analyzing each component: The first letter sequence: F, H, J, __, N The pattern here is increasing by 2: F (+2) → H, H (+2) → J. Following this, J (+2) → L. So, the first letter of the missing term is L. The third letter sequence: G, I, K, __, O The pattern is the same as the first sequence: G (+2) → I, I (+2) → K. So, K (+2) → M. The third letter of the missing term is M. The last letter sequence: B, B, B, __, B The pattern is consistent: the letter B repeats. So, the last letter of the missing term is B. Combining these, the missing term is LXM(B). The answer is C. LXL(B)D. ---- Unfortunately I did not make up the question myself, so is it already in the training set?
- root_axis 3y ago
  This response is actually quite illustrative of the stochastic nature of LLMs. Under normal circumstances a human would never make this kind of error. The system remains coherent long enough to produce the right answer, yet it still confidentially selects the wrong answer because it only understands the question as a function of statistical relationships between tokens, unlike humans who would understand the question at a conceptual level.
- kenjackson 3y ago
  I asked the question on GPT 4 and got the right answer: To solve this logical reasoning problem, we need to look for patterns in the given sequence: FXGB, HXIB, JXKB, _____, NXOB. 1. Analyzing the first and last letters of each group: - FXGB → HXIB → JXKB → ? → NXOB - F → H → J → ? → N Here, the pattern in the first letter seems to be skipping one letter in the alphabet each time (F +2 → H, H +2 → J, J +2 → L). So, the first letter of the missing group should be L. Looking at the last letter, we see a similar pattern: - B → B → B → ? → B The last letter is consistently B, so the last letter of the missing group should also be B. 2. Now, for the middle letters: - FXGB → HXIB → JXKB → ? → NXOB The middle letter appears to be consistently 'X', and the next letter is incrementing by one each time (G → I → K → ? → O). Following this pattern, the letter after 'X' should be M (K +1 → L, L +1 → M). So, putting it all together, the sequence should be LXMB, which is option D. Therefore, the correct answer is D. LXMB.

usaar333 3y ago

Note that the goal of ASI isn't to beat you per se, but the best humans. GPT-4 is generally not competitive with domain specialists (outside areas where machines have already been competitive for some time). That of course doesn't mean it isn't valuable - but it becomes more for human augmentation than replacement.

RecycledEle 3y ago
ASI stands for Artificial Superintelligence.
- godelski 3y ago
  > ASI stands for Artificial Superintelligence. >> Note that the goal of ASI isn't to beat you per se, but the best humans. I'm pretty sure they understand that.
  - RecycledEle 3y ago
    Before ASI can beat the best humans, it is going to wipe the floor with me. Maybe I'm selfish, but it's the time when my boss decides my worth that I'm concentrating on.
RecycledEle 3y ago
I don't see it as a dialectic. I see it as a continuum. There is value to replacing a percentage of human labor with machine labor. Jordan Peterson said there are no jobs in the USA for people with IQs below 87: https://www.youtube.com/watch?v=RN3w_F9r-aI&t=338s https://www.youtube.com/watch?v=RN3w_F9r-aI&t=338s Mr. Peterson says lower IQ people are do better at more repetitive jobs. Machines and AI can do more repetitive jobs. Technology took those jobs. As AI advances, the lowest useful IQ will move up. I wonder where it will be in 10 years.
- deleted 3y ago
  [deleted]
- 3y ago

greenthrow 3y ago

These are not "ways" of achieving superhuman intelligence, these are potential forms of superhuman performance. It's also a very broad definition, because by that definition we have had superhuman performance in computation for decades. And we've been able to write programs for very narrow tasks that outperform humans for that time as well. Generally when people are comparing artificial intelligence against human intelligence, they want an AGI. Humans aren't good at just one narrow thing, that's why they aren't all replaced by specialized programs already. We are taking about being able to describe a problem and the artificial intelligence can take it from there. That's why the bar is AGI, which is a much higher bar than any of your broad definitions.

pixl97 3y ago
Though I think we should take note that the write programs for very narrow tasks that outperform humans may start seeing widening. Things like object recognition have moved from "only humans can do this" to machines are keeping up with us. And I think that this is how it will be for at least some time. Instead of one big blast where ASI is better than humans at everything, more and more categories of narrow intelligence will widen and become superhuman.