4 ms·

Since this is on arxiv one presumes it's not been peer reviewed yet, right? Is there a way to leave comments? There are a couple of confusing language/grammar m

Since this is on arxiv one presumes it's not been peer reviewed yet, right? Is there a way to leave comments? There are a couple of confusing language/grammar mistakes including some in the first sentence.

behnamoh 3y ago
If there's anything I've learnt in the past year about LLMs, it's this: there's so much hype, ungrounded research "findings", and next-big-thing libraries (remember langchain?) LLMs, at least the ones companies use, are APIs all the way down. Stay away from anything or anyone who claims they've discovered something no one else knew about LLMs.
- aalimov_ 3y ago
  Maybe staying away from someone selling something while making that claim, but staying curious seems appropriate. > LLMs, at least the ones companies use, are APIs all the way down. Really does seem like it. So many interesting little projects that end up being nothing more than a hidden prompt and an api call to OpenAI
scott_s 3y ago
Email the first author.
mcphage 3y ago
Even the first sentence of the summary is unclear: > When human programmers have mastered a programming language, it would be easier when they learn a new programming language. I think they're saying "When human programmers have mastered a programming language, it makes it easier for them to learn a new programming language", but... I'm not entirely sure.
- toast0 3y ago
  Yeah, that's what they're saying. English is not an easy language. "It would be easier to learn a programming language, when you have mastered any other programming language" is clear, IMHO, but flipping the clauses makes it less clear.
  - HappMacDonald 3y ago
    > English is not an easy language. "ChatGPT, please translate my incoherent stream of consciousness into clear English" then review its output like one would a rough draft, and repeat as needed. As far as human languages go, yes English is at least B-tier difficulty. Not least of which due to having the largest working vocabulary on Earth. But for all of the problems that LLMs might have with object permanence and memory and such, I think it's pretty safe to say that GPT3+ has mastered both the commonly used vocabulary and even the most subtle turns of grammar in the English Language. Which is never going to not dumbfound me. O_O
deleted 3y ago
[deleted]

behnamoh 3y ago

If there's anything I've learnt in the past year about LLMs, it's this: there's so much hype, ungrounded research "findings", and next-big-thing libraries (remember langchain?) LLMs, at least the ones companies use, are APIs all the way down. Stay away from anything or anyone who claims they've discovered something no one else knew about LLMs.

aalimov_ 3y ago
Maybe staying away from someone selling something while making that claim, but staying curious seems appropriate. > LLMs, at least the ones companies use, are APIs all the way down. Really does seem like it. So many interesting little projects that end up being nothing more than a hidden prompt and an api call to OpenAI

scott_s 3y ago

Email the first author.

mcphage 3y ago

Even the first sentence of the summary is unclear: > When human programmers have mastered a programming language, it would be easier when they learn a new programming language. I think they're saying "When human programmers have mastered a programming language, it makes it easier for them to learn a new programming language", but... I'm not entirely sure.

toast0 3y ago
Yeah, that's what they're saying. English is not an easy language. "It would be easier to learn a programming language, when you have mastered any other programming language" is clear, IMHO, but flipping the clauses makes it less clear.
- HappMacDonald 3y ago
  > English is not an easy language. "ChatGPT, please translate my incoherent stream of consciousness into clear English" then review its output like one would a rough draft, and repeat as needed. As far as human languages go, yes English is at least B-tier difficulty. Not least of which due to having the largest working vocabulary on Earth. But for all of the problems that LLMs might have with object permanence and memory and such, I think it's pretty safe to say that GPT3+ has mastered both the commonly used vocabulary and even the most subtle turns of grammar in the English Language. Which is never going to not dumbfound me. O_O

deleted 3y ago

[deleted]