7 ms·

AlphaCode Attention Visualization

144 points by MurizS 4y ago

ladon86 4y ago
For context on what this is, here is the associated blog post: https://www.deepmind.com/blog/competitive-programming-with-alphacode https://www.deepmind.com/blog/competitive-programming-with-a...
- dang 4y ago
  One previous thread: Competitive Programming with AlphaCode - https://news.ycombinator.com/item?id=30179549 https://news.ycombinator.com/item?id=30179549 - Feb 2022 (397 comments)
deleted 4y ago
[deleted]
johnthuss 4y ago
"As part of DeepMind’s mission to solve intelligence, we created a system called AlphaCode that writes computer programs at a competitive level. AlphaCode achieved an estimated rank within the top 54% of participants in programming competitions by solving new problems that require a combination of critical thinking, logic, algorithms, coding, and natural language understanding."
- pifm_guy 4y ago
  Worth noting that in many programming competitions online, a large chunk of competitors either don't submit anything, or only submit a little example.
  - sdenton4 4y ago
    The real question is whether DeepMind can create a model which can outrun the goalposts.
tromp 4y ago
Will we ever see the day when AlphaIOCCC submits a winning entry?
jw1224 4y ago
Has Google/Alphabet publicly released any of their AI models yet? I’ve seen plenty of hype surrounding Imagen [1] and Parti [2], but as far as I know, they’re still vaporware. Normally I wouldn’t think too hard about this, but two things come to mind here: Firstly, the speed at which competitors are launching and developing new AI models. Imagen/Parti both seem to rival Stable Diffusion and DALL-E… why can’t we use them yet? Secondly (and perhaps this is clouding my judgment), the fact a Midjourney founder mentioned during an Office Hours session that [paraphrasing]: “it’s widely known in the industry that 90% of AI research is completely made-up garbage”… [1] https://imagen.research.google/ https://imagen.research.google/ [2] https://parti.research.google/ https://parti.research.google/
- deleted 4y ago
  [deleted]
- jiggawatts 4y ago
  The cultures at the various leading AI research organisations are wildly divergent. Google is full of people that for a want of a better word are simply arrogant. They think that the purpose of AI is for them to show off their skills and... that's it. At best they'd use it internally for selling you more ads, they don't seem to think other people are worthy of using the output of their efforts in any shape, way, or form. OpenAI is full of boyscouts that think that AI should be carefully censored so that it represents black, brown, asian, and white people equally. They deliberately skew the training data to enshrine wokeness into the product, while also trying to prevent anyone using their models to generate anything vaguely like porn. Basically, they're digital mormons. No fun. Stability AI / Stable Diffusion is a bunch of people that had money thrown at them with no guard rails. Anything goes. Download our models and have fun! Make porn if you want to. Whatever. To nobody's surprise, only the latter is of any interest or use to the general public. The sad part is that Google had the most resources to spend on training their models, and it's the least accessible. It's like Tony Stark inventing cold fusion energy and then using only to power his suit instead of... you know... changing the world for the better.
  - alphabetting 4y ago
iLoveOncall 4y ago
The fact that the amount of text you have to write is greater than the amount of code AlphaCode writes should reassure programmers afraid that their job will ever be taken over by AI.
- japanman425 4y ago
- DoingIsLearning 4y ago
  We should really let go of words per minute or typing effort as a useful metric. Most of our time is spent thinking about what to write not the actual writing. Also nothing stopping it from being a voice input rather than typing.
  - iLoveOncall 4y ago
    That's not what I meant. I'm saying that it is more overall effort to code this way than to code by just writing code.
Briggs958 4y ago
[dead]
duckydude20 4y ago
i don't know much about ai or anything. but i would really like if ai can replace competitive programming. i really hate it. it's not programming and a very bad merit to judge. it's one of the thing i hates the most. i hope this type of things makes us rethink how we are judging the people. and how cp rank one cannot design a full system which is maintainable and easy to reason about.

144 points by MurizS 4y ago

For context on what this is, here is the associated blog post: https://www.deepmind.com/blog/competitive-programming-with-alphacode https://www.deepmind.com/blog/competitive-programming-with-a...

dang 4y ago
One previous thread: Competitive Programming with AlphaCode - https://news.ycombinator.com/item?id=30179549 https://news.ycombinator.com/item?id=30179549 - Feb 2022 (397 comments)

deleted 4y ago

[deleted]

johnthuss 4y ago

"As part of DeepMind’s mission to solve intelligence, we created a system called AlphaCode that writes computer programs at a competitive level. AlphaCode achieved an estimated rank within the top 54% of participants in programming competitions by solving new problems that require a combination of critical thinking, logic, algorithms, coding, and natural language understanding."

pifm_guy 4y ago
Worth noting that in many programming competitions online, a large chunk of competitors either don't submit anything, or only submit a little example.
- sdenton4 4y ago
  The real question is whether DeepMind can create a model which can outrun the goalposts.

tromp 4y ago

Will we ever see the day when AlphaIOCCC submits a winning entry?

jw1224 4y ago

Has Google/Alphabet publicly released any of their AI models yet? I’ve seen plenty of hype surrounding Imagen [1] and Parti [2], but as far as I know, they’re still vaporware. Normally I wouldn’t think too hard about this, but two things come to mind here: Firstly, the speed at which competitors are launching and developing new AI models. Imagen/Parti both seem to rival Stable Diffusion and DALL-E… why can’t we use them yet? Secondly (and perhaps this is clouding my judgment), the fact a Midjourney founder mentioned during an Office Hours session that [paraphrasing]: “it’s widely known in the industry that 90% of AI research is completely made-up garbage”… [1] https://imagen.research.google/ https://imagen.research.google/ [2] https://parti.research.google/ https://parti.research.google/

deleted 4y ago
[deleted]
jiggawatts 4y ago
The cultures at the various leading AI research organisations are wildly divergent. Google is full of people that for a want of a better word are simply arrogant. They think that the purpose of AI is for them to show off their skills and... that's it. At best they'd use it internally for selling you more ads, they don't seem to think other people are worthy of using the output of their efforts in any shape, way, or form. OpenAI is full of boyscouts that think that AI should be carefully censored so that it represents black, brown, asian, and white people equally. They deliberately skew the training data to enshrine wokeness into the product, while also trying to prevent anyone using their models to generate anything vaguely like porn. Basically, they're digital mormons. No fun. Stability AI / Stable Diffusion is a bunch of people that had money thrown at them with no guard rails. Anything goes. Download our models and have fun! Make porn if you want to. Whatever. To nobody's surprise, only the latter is of any interest or use to the general public. The sad part is that Google had the most resources to spend on training their models, and it's the least accessible. It's like Tony Stark inventing cold fusion energy and then using only to power his suit instead of... you know... changing the world for the better.
- alphabetting 4y ago

iLoveOncall 4y ago

The fact that the amount of text you have to write is greater than the amount of code AlphaCode writes should reassure programmers afraid that their job will ever be taken over by AI.

japanman425 4y ago
DoingIsLearning 4y ago
We should really let go of words per minute or typing effort as a useful metric. Most of our time is spent thinking about what to write not the actual writing. Also nothing stopping it from being a voice input rather than typing.
- iLoveOncall 4y ago
  That's not what I meant. I'm saying that it is more overall effort to code this way than to code by just writing code.

Briggs958 4y ago

[dead]

duckydude20 4y ago

i don't know much about ai or anything. but i would really like if ai can replace competitive programming. i really hate it. it's not programming and a very bad merit to judge. it's one of the thing i hates the most. i hope this type of things makes us rethink how we are judging the people. and how cp rank one cannot design a full system which is maintainable and easy to reason about.