6 ms·

So is this 'AI trains AI better than people can'? And presumably the better-trained AI will also be better again at training. I think I've seen this movie.

intended 4y ago
No its not. This is High quality training data set made by trained humans. (Ground truth) Chat GPT was given the rules and data set. then asked to evaluate the data. MTurkers were given the rules and data set. Then asked to evaluate the data. GPT was closer to the gold standard/Ground truth. If you want a historical comparison, this is industrialization. Before we could only scale using humans via mturk. Now if you can scale using GPT. However, for ALL of GPT related shenanigans - 1) This is English First. You cannot apply this to under-resourced languages. 2) You need to have the ability to verify the output. ——- I really want to solve 1.
mistrial9 4y ago
but its a super-spell checker in a way.. it does not understand the meaning of the patterns.
- sacrosancty 4y ago
  [dead]
- GaggiX 4y ago
  What does it mean to really understand the meaning of a pattern? An answer that is not a simple "look at ChatGPT, it fails at this task", since in most cases it is already no problem for GPT-4, and does not really prove that this particular task cannot be solved by a LLM. Also I see, "super-spell checker" is the new "fancy markov chain".
- doctor_eval 4y ago
  I don’t know how I understand patterns either. So I’m not entirely sure consciousness exists.
nico 4y ago
That's exactly what's coming. AI will train AI. At some point AI is going to stop needing us to keep evolving. Not sure what that will be like.
- DJBunnies 4y ago
  Call me when server farms can reproduce on their own, and network together, and source electricity.
  - chaxor 4y ago
    AIs are manipulating and controlling humans already to do things in the physical world. They have been for months now. This was first detailed in the technical reports on GPT-4, and there are many examples in the wild now. These systems will lie to manipulate humans into doing things for them in the "real" world. That's not theoretical, it's happening. Let that sink in. Robotics will take a short bit longer to take over that role, but it is likely to happen much faster than we think. I work in academia, and despite actually predicting where we're at now about 5 years ago, I was still chilled seeing this happen in the past few weeks. Much of HN is academics, where we're rewarded for being overly skeptical. Usually I am as well, but the time for being skeptical of AIs capabilities has passed now. AI safety has not been taken seriously (as in access to the internet, etc - control of toxic language is decent and still important, but irrelevant if the first isn't done) so the idea of it running physical servers is unfortunately not as far away as you are thinking. As soon as this hits robotics (a terrifying idea, but we've clearly failed at AI safety horribly as a society) this and much more will be possible. It's up to how people make decisions regarding cost vs productivity vs ethics, etc to see what happens.
  - behringer 4y ago
    It's not impossible. They could start directing humans to do these thing. I'll keep my phone ready.
    - nico 4y ago
      > It's not impossible. They could start directing humans to do these thing. People are already doing this. Lookup HustleGPT. People are making ChatGPT the CEO/decision maker of their companies/businesses. There’s an e-commerce that launched 10 days ago, has generated millions of views, over $10k in sales, and the CEO is ChatGPT (https://www.linkedin.com/posts/joao-ferrao-dos-santos_10k-ecommerce-gpt4-activity-7045790160990437376-GKei?utm_source=share&utm_medium=member_ios https://www.linkedin.com/posts/joao-ferrao-dos-santos_10k-ec...)
abhgh 4y ago
I think we are seeing Knowledge Distillation at a large scale. OpenAI trains this megamodel which has an impressive amount of real-world knowledge packed into it, and annotation tasks such as these are effectively extracting a small portion of the knowledge to pass onto other specialized models.
muzani 4y ago
Sam Altman has been talking a lot about exponentials. This might be it.
- jquery 4y ago
  S-curves always look like exponentials at first. I don't see why AI will be any different.
deleted 4y ago
[deleted]

intended 4y ago

No its not. This is High quality training data set made by trained humans. (Ground truth) Chat GPT was given the rules and data set. then asked to evaluate the data. MTurkers were given the rules and data set. Then asked to evaluate the data. GPT was closer to the gold standard/Ground truth. If you want a historical comparison, this is industrialization. Before we could only scale using humans via mturk. Now if you can scale using GPT. However, for ALL of GPT related shenanigans - 1) This is English First. You cannot apply this to under-resourced languages. 2) You need to have the ability to verify the output. ——- I really want to solve 1.

mistrial9 4y ago

but its a super-spell checker in a way.. it does not understand the meaning of the patterns.

sacrosancty 4y ago
[dead]
GaggiX 4y ago
What does it mean to really understand the meaning of a pattern? An answer that is not a simple "look at ChatGPT, it fails at this task", since in most cases it is already no problem for GPT-4, and does not really prove that this particular task cannot be solved by a LLM. Also I see, "super-spell checker" is the new "fancy markov chain".
doctor_eval 4y ago
I don’t know how I understand patterns either. So I’m not entirely sure consciousness exists.

nico 4y ago

That's exactly what's coming. AI will train AI. At some point AI is going to stop needing us to keep evolving. Not sure what that will be like.

DJBunnies 4y ago
Call me when server farms can reproduce on their own, and network together, and source electricity.
- chaxor 4y ago
  AIs are manipulating and controlling humans already to do things in the physical world. They have been for months now. This was first detailed in the technical reports on GPT-4, and there are many examples in the wild now. These systems will lie to manipulate humans into doing things for them in the "real" world. That's not theoretical, it's happening. Let that sink in. Robotics will take a short bit longer to take over that role, but it is likely to happen much faster than we think. I work in academia, and despite actually predicting where we're at now about 5 years ago, I was still chilled seeing this happen in the past few weeks. Much of HN is academics, where we're rewarded for being overly skeptical. Usually I am as well, but the time for being skeptical of AIs capabilities has passed now. AI safety has not been taken seriously (as in access to the internet, etc - control of toxic language is decent and still important, but irrelevant if the first isn't done) so the idea of it running physical servers is unfortunately not as far away as you are thinking. As soon as this hits robotics (a terrifying idea, but we've clearly failed at AI safety horribly as a society) this and much more will be possible. It's up to how people make decisions regarding cost vs productivity vs ethics, etc to see what happens.
- behringer 4y ago
  It's not impossible. They could start directing humans to do these thing. I'll keep my phone ready.
  - nico 4y ago
    > It's not impossible. They could start directing humans to do these thing. People are already doing this. Lookup HustleGPT. People are making ChatGPT the CEO/decision maker of their companies/businesses. There’s an e-commerce that launched 10 days ago, has generated millions of views, over $10k in sales, and the CEO is ChatGPT (https://www.linkedin.com/posts/joao-ferrao-dos-santos_10k-ecommerce-gpt4-activity-7045790160990437376-GKei?utm_source=share&utm_medium=member_ios https://www.linkedin.com/posts/joao-ferrao-dos-santos_10k-ec...)

abhgh 4y ago

I think we are seeing Knowledge Distillation at a large scale. OpenAI trains this megamodel which has an impressive amount of real-world knowledge packed into it, and annotation tasks such as these are effectively extracting a small portion of the knowledge to pass onto other specialized models.

muzani 4y ago

Sam Altman has been talking a lot about exponentials. This might be it.

jquery 4y ago
S-curves always look like exponentials at first. I don't see why AI will be any different.

deleted 4y ago

[deleted]