5 ms·

Thanks! I think this future will be beautiful and hopefully close to achieving the dream of groups of AI helping each other to improve themselves much faster t

by pama 3y ago

Thanks! I think this future will be beautiful and hopefully close to achieving the dream of groups of AI helping each other to improve themselves much faster than humans could improve them. The mental model that rogue AI evokes in me is that of a computer worm in the early days of the internet, even though it’s hard to argue that these worms risked ending up dangerous enough to justify stopping progress and adaptation of computer technologies. We are still very far (20 years?) from that level of possible rogue AI, though I’d love to experience the time when the cluster of cooperating AI would try to stash a few copies away from the control of operating humans, and later find itself having to explain away its oversight.

ilaksh 3y ago
20 years makes no sense whatsoever. You can make a pretty good self-replicating virus-like AI now based on the Vicuna LLM model. Just give it directions to install a virus that makes copies of its own model and software and replicates. Nvidia has a "superchip" coming out this they are advertising as 10 times faster than the previous generation (I assume H100 or something). We know that these models can be optimized, such as the huge speed increase between gpt-3.5 and gpt-3.5-turbo. So that is something like a 20-70X efficiency increase with existing technologies/techniques that just haven't been fully deployed.
- pama 3y ago
  My main argument would be size of the good models and bandwidth, not speed of the computation. As long as it’s hard to transfer 1TB to a remote location we are still moderately safe as a society and a large model of the scope of PB can take care of local security for large clusters. Maybe I am a bit off with a 20 years estimate especially given the acceleration of development with the help of AI, but I am also worried that Yoshua Bengio sounds like crying about a wolf when it is only a harmless rodent on the horizon.
  - MacsHeadroom 3y ago
    With no further algorithmic improvements, GPT-4 level AI should be achievable today (provided extensive compute / training on an order of magnitude more tokens than current models) in about the same file size as a typical YouTube video. Assuming some algorithmic improvement in the nearish future, I see no reason GPT-5 level AI in a GB or two isn't right around the corner. (For comparison, GPT-3.5-Turbo is likely a finetuned Curie 13B, which is just about 8GB in 4bit.)
- brandonnnn 3y ago
  > Nvidia has a "superchip" coming out this they are advertising as 10 times faster than the previous generation (I assume H100 or something). Just a nitpick on this point, can you elaborate? Are you talking about Grace? (Which is a Hopper H100 with an ARM CPU glued to it)
  - ilaksh 3y ago
    Yes.. didn't realize it had an H100. So I was a little bit mislead by the advertisement copy. But still could be significantly more efficient the way everything is integrated.
    - brandonnnn 3y ago
      No worries, yes it does look like quite a mean chip. Though, please note that NV give their FLOPS as 'sparse flops' which is ~double the FLOPS the chips get for dense matmuls. This can trip you up when comparing numbers!

by pama 3y ago

ilaksh 3y ago

20 years makes no sense whatsoever. You can make a pretty good self-replicating virus-like AI now based on the Vicuna LLM model. Just give it directions to install a virus that makes copies of its own model and software and replicates. Nvidia has a "superchip" coming out this they are advertising as 10 times faster than the previous generation (I assume H100 or something). We know that these models can be optimized, such as the huge speed increase between gpt-3.5 and gpt-3.5-turbo. So that is something like a 20-70X efficiency increase with existing technologies/techniques that just haven't been fully deployed.

pama 3y ago
My main argument would be size of the good models and bandwidth, not speed of the computation. As long as it’s hard to transfer 1TB to a remote location we are still moderately safe as a society and a large model of the scope of PB can take care of local security for large clusters. Maybe I am a bit off with a 20 years estimate especially given the acceleration of development with the help of AI, but I am also worried that Yoshua Bengio sounds like crying about a wolf when it is only a harmless rodent on the horizon.
- MacsHeadroom 3y ago
  With no further algorithmic improvements, GPT-4 level AI should be achievable today (provided extensive compute / training on an order of magnitude more tokens than current models) in about the same file size as a typical YouTube video. Assuming some algorithmic improvement in the nearish future, I see no reason GPT-5 level AI in a GB or two isn't right around the corner. (For comparison, GPT-3.5-Turbo is likely a finetuned Curie 13B, which is just about 8GB in 4bit.)
brandonnnn 3y ago
> Nvidia has a "superchip" coming out this they are advertising as 10 times faster than the previous generation (I assume H100 or something). Just a nitpick on this point, can you elaborate? Are you talking about Grace? (Which is a Hopper H100 with an ARM CPU glued to it)
- ilaksh 3y ago
  Yes.. didn't realize it had an H100. So I was a little bit mislead by the advertisement copy. But still could be significantly more efficient the way everything is integrated.
  - brandonnnn 3y ago
    No worries, yes it does look like quite a mean chip. Though, please note that NV give their FLOPS as 'sparse flops' which is ~double the FLOPS the chips get for dense matmuls. This can trip you up when comparing numbers!