3 ms·

This is an example of superior intellectual performance to humans. There’s no denying it. This task is intellectual. Does not involve rote memorization. There

This is an example of superior intellectual performance to humans. There’s no denying it. This task is intellectual. Does not involve rote memorization. There are not tons and tons of data pairs on the web of minimized code and unminified code for llms to learn from. The llm understands what it is unminifying and it is in general superior to humans on this regard. But only in this specific subject.

indoordin0saur 2y ago
This is just transforming text. > There are not tons and tons of data pairs on the web of minimized code and unminified code for llms to learn from. Are you sure about this? These can be easily generated from existing JS to use as a training set, not to mention the enormous amount of non-minified JS which is already used to train it.
ozr 2y ago
I'm bullish on AI, but I'm not convinced this is an example of what you're describing. The challenge of understanding minified code for a human comes from opaque variable names, awkward loops, minimal whitespacing, etc. These aren't things that a computer has trouble with: it's why we minify in the first place. Attention, as a scheme, should do great with it. I'd also say there is tons of minified/non-minified code out there. That's the goal of a map file. Given that OpenAI has specifically invested in web browsing and software development, I wouldn't be surprised if part of their training involved minified/unminified data.
- ninetyninenine 2y ago
  minification and unminification is a heuristic process not an algorithmic one. It is akin to decompiling code or reverse engineering. It's a step beyond just your typical AI you see in a calculator.
- etbebl 2y ago
  > These aren't things that a computer has trouble with They are irrelevant for executing the code, but they're probably pretty relevant for an LLM that is ingesting the code and text and inferring its function based on other examples it has seen. It's definitely more impressive that an LLM can succeed at this without the context of (correct) variable names than with them.
danbolt 2y ago
I don’t claim expertise in AI or understanding intelligence, but could we also say that a pocket calculator really understands arithmetic and has superior intellectual performance compared to humans?
- ninetyninenine 2y ago
  https://chatgpt.com/share/a430518b-16f8-47bb-8cb7-d9b851837660 https://chatgpt.com/share/a430518b-16f8-47bb-8cb7-d9b8518376...
- pornel 2y ago
  Things are called AI only until they can be done well by a computer, and then they become just an algorithm. There was a time when winning in Chess was a proof of humans' superior intellect, and then it became just an algorithm. Then Go.
mplewis 2y ago
Yeah, ok. Now count the number of Rs in this word.
plaidfuji 2y ago
I think I’d agree with your statement, in the same sense that a chess simulator or AlphaGo are superior to human intellect for their specific problem spaces. LLMs are very good at a surprisingly broad array of semi-structured-text-to-semi-structured-text transformations, particularly within the manifold of text that is widely available on the internet. It just so happens that lots of code is widely available on the internet, so LLMs tend to outperform on coding tasks. There’s also lots of marketing copy, general “encyclopedic” knowledge, news, human commentary, and entertainment artifacts (scripts, lyrics, etc). LLMs traverse those spaces handily as well. The capabilities of AI ultimately boil down to their underlying dataset and its quality.
deleted 2y ago
[deleted]
gmd63 2y ago
> Does not involve rote memorization. There are not tons and tons of data pairs on the web of minimized code and unminified code for llms to learn from. GPT-4 has consumed more code than your entire lineage ever will and understands the inherent patterns between code and minified versions. Recognizing the abstract shape of code sans variable names and mapping in some human readable variable names from a similar pattern you've consumed from the vast internet doesn't seem farfetched.
- okanat 2y ago
  And a human can do it without seeing that amount of code and consuming less energy.
  - lgas 2y ago
    Sure but it’s tedious and time consuming. I like things that eliminate tedium and give me back time.
throwthrowuknow 2y ago
Umm yeah there are tons of examples in Github repos.
dontlikeyoueith 2y ago
Yes, bow down before your god. You people are so weird.
- ninetyninenine 2y ago
  You're in denial. Nobody is worshipping a god here. I'm simply saying the AI has superior performance to humans on this specific subject. That's all. Why did you suddenly make this comment of "bowing before your god" when I didn't even mention anything remotely close to that? I'll tell you why. Because this didn't come from me. It came from YOU. This is what YOU fear most. This is what YOU think about. And your fear of this is what blinds you to the truth.
hamstergene 2y ago
Why not count the fact that humans created a tool to help themselves at unminifying towards human score? Having a computer multiplying 1000-digit numbers instantly is an example of humans succeeding at multiplying: by creating a tool for that first. Because what else is intellectually succeeding there? It’s not like the computer has created itself. If one draws a boundary of human intelligence at the skull bone and does not count the tools that this very intelligence is creating and using as mere steps of problem solving process, then one will also have to accept that humans are not intelligent enough to fly into space or do surgery or even cook most of the meals.
seadan83 2y ago
> This is an example of superior intellectual performance to humans. So is too multiplying _many_ large numbers together. > The llm understands what it is unminifying and it is in general superior to humans on this regard. Proof needed. I would grant in terms of speed as very likely to be true. In general, I do not know how accuracy would compare.

indoordin0saur 2y ago

This is just transforming text. > There are not tons and tons of data pairs on the web of minimized code and unminified code for llms to learn from. Are you sure about this? These can be easily generated from existing JS to use as a training set, not to mention the enormous amount of non-minified JS which is already used to train it.

ozr 2y ago

I'm bullish on AI, but I'm not convinced this is an example of what you're describing. The challenge of understanding minified code for a human comes from opaque variable names, awkward loops, minimal whitespacing, etc. These aren't things that a computer has trouble with: it's why we minify in the first place. Attention, as a scheme, should do great with it. I'd also say there is tons of minified/non-minified code out there. That's the goal of a map file. Given that OpenAI has specifically invested in web browsing and software development, I wouldn't be surprised if part of their training involved minified/unminified data.

ninetyninenine 2y ago
minification and unminification is a heuristic process not an algorithmic one. It is akin to decompiling code or reverse engineering. It's a step beyond just your typical AI you see in a calculator.
etbebl 2y ago
> These aren't things that a computer has trouble with They are irrelevant for executing the code, but they're probably pretty relevant for an LLM that is ingesting the code and text and inferring its function based on other examples it has seen. It's definitely more impressive that an LLM can succeed at this without the context of (correct) variable names than with them.

danbolt 2y ago

I don’t claim expertise in AI or understanding intelligence, but could we also say that a pocket calculator really understands arithmetic and has superior intellectual performance compared to humans?

ninetyninenine 2y ago
https://chatgpt.com/share/a430518b-16f8-47bb-8cb7-d9b851837660 https://chatgpt.com/share/a430518b-16f8-47bb-8cb7-d9b8518376...
pornel 2y ago
Things are called AI only until they can be done well by a computer, and then they become just an algorithm. There was a time when winning in Chess was a proof of humans' superior intellect, and then it became just an algorithm. Then Go.

mplewis 2y ago

Yeah, ok. Now count the number of Rs in this word.

plaidfuji 2y ago

I think I’d agree with your statement, in the same sense that a chess simulator or AlphaGo are superior to human intellect for their specific problem spaces. LLMs are very good at a surprisingly broad array of semi-structured-text-to-semi-structured-text transformations, particularly within the manifold of text that is widely available on the internet. It just so happens that lots of code is widely available on the internet, so LLMs tend to outperform on coding tasks. There’s also lots of marketing copy, general “encyclopedic” knowledge, news, human commentary, and entertainment artifacts (scripts, lyrics, etc). LLMs traverse those spaces handily as well. The capabilities of AI ultimately boil down to their underlying dataset and its quality.

deleted 2y ago

[deleted]

gmd63 2y ago

> Does not involve rote memorization. There are not tons and tons of data pairs on the web of minimized code and unminified code for llms to learn from. GPT-4 has consumed more code than your entire lineage ever will and understands the inherent patterns between code and minified versions. Recognizing the abstract shape of code sans variable names and mapping in some human readable variable names from a similar pattern you've consumed from the vast internet doesn't seem farfetched.

okanat 2y ago
And a human can do it without seeing that amount of code and consuming less energy.
- lgas 2y ago
  Sure but it’s tedious and time consuming. I like things that eliminate tedium and give me back time.

throwthrowuknow 2y ago

Umm yeah there are tons of examples in Github repos.

dontlikeyoueith 2y ago

Yes, bow down before your god. You people are so weird.

ninetyninenine 2y ago
You're in denial. Nobody is worshipping a god here. I'm simply saying the AI has superior performance to humans on this specific subject. That's all. Why did you suddenly make this comment of "bowing before your god" when I didn't even mention anything remotely close to that? I'll tell you why. Because this didn't come from me. It came from YOU. This is what YOU fear most. This is what YOU think about. And your fear of this is what blinds you to the truth.

hamstergene 2y ago

Why not count the fact that humans created a tool to help themselves at unminifying towards human score? Having a computer multiplying 1000-digit numbers instantly is an example of humans succeeding at multiplying: by creating a tool for that first. Because what else is intellectually succeeding there? It’s not like the computer has created itself. If one draws a boundary of human intelligence at the skull bone and does not count the tools that this very intelligence is creating and using as mere steps of problem solving process, then one will also have to accept that humans are not intelligent enough to fly into space or do surgery or even cook most of the meals.

seadan83 2y ago

> This is an example of superior intellectual performance to humans. So is too multiplying _many_ large numbers together. > The llm understands what it is unminifying and it is in general superior to humans on this regard. Proof needed. I would grant in terms of speed as very likely to be true. In general, I do not know how accuracy would compare.