4 ms·

I can't really take seriously any research with "elevates the LLM from a nascent model to a formidable one" in the abstract... If you want to catch my attentio

I can't really take seriously any research with "elevates the LLM from a nascent model to a formidable one" in the abstract... If you want to catch my attention, say "+XX% at [benchmark], with the same number of weights and training data".

eigenket 3y ago
In their defence, the authors are > Zixiang Chen, Yihe Deng, Huizhuo Yuan, Kaixuan Ji, Quanquan Gu I'm guessing from how the introduction is written they aren't native English speakers, so they shouldn't be judged as if they are. Presumably the stuff they write sounds more normal in their native language(s).
- londons_explore 3y ago
  I considered that... but no matter the language, in science, numbers are always preferred over "wow big amazing woo!"
- andy99 3y ago
  The authors all have UCLA email addresses. Having a foreign name doesn't mean you can't speak English.
  - eigenket 3y ago
    I never said that having a foreign name doesn't mean you can't speak English, but writing a serious paper where the first sentence starts > Large Language Models (LLMs) have began a groundbreaking era in artificial general intelligence Pretty strongly suggests that your work should be judged on its scientific (and not linguistic) merit.
gchamonlive 3y ago
Tuning down these qualifiers perceived as subjective and focusing on the important stuff is a fine skill to develop. Maybe this is a useful research for you and you are passing it down because of cosmetics.
leothetechguy 3y ago
Just read the paper, or open the paper and scroll down to the first bar graph you see.
cjbprime 3y ago
That's especially valuable since it's normally impossible to take even the benchmark percentage increase claims seriously for LLM research, because they're usually reached through training set contamination of the test questions. But your requirement of not introducing any new outside training data to an existing published model would take care of that.

eigenket 3y ago

In their defence, the authors are > Zixiang Chen, Yihe Deng, Huizhuo Yuan, Kaixuan Ji, Quanquan Gu I'm guessing from how the introduction is written they aren't native English speakers, so they shouldn't be judged as if they are. Presumably the stuff they write sounds more normal in their native language(s).

londons_explore 3y ago
I considered that... but no matter the language, in science, numbers are always preferred over "wow big amazing woo!"
andy99 3y ago
The authors all have UCLA email addresses. Having a foreign name doesn't mean you can't speak English.
- eigenket 3y ago
  I never said that having a foreign name doesn't mean you can't speak English, but writing a serious paper where the first sentence starts > Large Language Models (LLMs) have began a groundbreaking era in artificial general intelligence Pretty strongly suggests that your work should be judged on its scientific (and not linguistic) merit.

gchamonlive 3y ago

Tuning down these qualifiers perceived as subjective and focusing on the important stuff is a fine skill to develop. Maybe this is a useful research for you and you are passing it down because of cosmetics.

leothetechguy 3y ago

Just read the paper, or open the paper and scroll down to the first bar graph you see.

cjbprime 3y ago

That's especially valuable since it's normally impossible to take even the benchmark percentage increase claims seriously for LLM research, because they're usually reached through training set contamination of the test questions. But your requirement of not introducing any new outside training data to an existing published model would take care of that.