4 ms·

The article is vague about the companies in the paper, for some reason. In the paper, OpenAI is at the top of the chart for cumulative citations. MEGVII, Huggi

The article is vague about the companies in the paper, for some reason. In the paper, OpenAI is at the top of the chart for cumulative citations. MEGVII, Hugging Face, Waymo, Momenta, Preferred Netowkrs, Anthropic, Owkin, and Databricks, and Aibee follow (in that order). Yes, that is citations, not publications, but they explain that they're trying to use that as a proxy for significance, albeit an imperfect one. Companies like Google aren't included because they aren't unicorn startups.

dominotw 3mo ago
databricks is a top ai startup?. i thought they did spark hosting or something. what makes them a top ai startup
- tfrancisl 3mo ago
  $160 billion valuation and market capture among some top (non-AI, traditional enterprise) companies, I think.
  - kloop 3mo ago
    Yeah, but that capture is usually just hosted spark usage. The AI usage has mostly been getting it to explain error messages
    - milkshakes 3mo ago
      they also have a pretty handy button right next to the error to ftfy
- deleted 3mo ago
  [deleted]
- muragekibicho 3mo ago
  They just raised their series Z or something lol.
larodi 3mo ago
Google published a lot. I still wonder this original transformer paper, and the attention, etc. Why would they allow it to let go in the open? Perhaps because was intended for translation first before someone decided to loop it over itself? Or was so obscure to fellow researchers what do they actually publish?
- willy_k 3mo ago
  It took 6 years to get from Attention Is All You Need to a consumer product. Up until ChatGPT’s release, LLMs were obscure and really were just fancier autocomplete. Deepmind was largely a speculative research division until Google decided to play catch up, and even that took a bit of time as they figured out how to proceed in a way that wouldn’t cannabalize search. So in short they didn’t realize the potential. Thats my somewhat naive take.
  - jeffbee 3mo ago
    Google itself was shipping transformer-based features to consumers within 2 years, notably BERT for websearch.
    - umeshunni 3mo ago
      and Google Translate: https://arxiv.org/abs/1804.09849 https://arxiv.org/abs/1804.09849
- leoh 3mo ago
  Kind of makes you wonder if there are other papers from Google that are potentially also profoundly groundbreaking but overlooked
  - whiplash451 3mo ago
    Groundbreaking includes the “explain to the world why it matters” part
npn 3mo ago
weird, for so long I'm damn sure that researchers are obligatory to release research papers to fulfill their quotas. otherwise they will lost their titles. so unless those companies (openai, anthropic) gave the researchers some fortune big enough to make them give up their research careers, they will keep publish research papers. aka it is not the good will of those companies.

dominotw 3mo ago

databricks is a top ai startup?. i thought they did spark hosting or something. what makes them a top ai startup

tfrancisl 3mo ago
$160 billion valuation and market capture among some top (non-AI, traditional enterprise) companies, I think.
- kloop 3mo ago
  Yeah, but that capture is usually just hosted spark usage. The AI usage has mostly been getting it to explain error messages
  - milkshakes 3mo ago
    they also have a pretty handy button right next to the error to ftfy
deleted 3mo ago
[deleted]
muragekibicho 3mo ago
They just raised their series Z or something lol.

larodi 3mo ago

Google published a lot. I still wonder this original transformer paper, and the attention, etc. Why would they allow it to let go in the open? Perhaps because was intended for translation first before someone decided to loop it over itself? Or was so obscure to fellow researchers what do they actually publish?

willy_k 3mo ago
It took 6 years to get from Attention Is All You Need to a consumer product. Up until ChatGPT’s release, LLMs were obscure and really were just fancier autocomplete. Deepmind was largely a speculative research division until Google decided to play catch up, and even that took a bit of time as they figured out how to proceed in a way that wouldn’t cannabalize search. So in short they didn’t realize the potential. Thats my somewhat naive take.
- jeffbee 3mo ago
  Google itself was shipping transformer-based features to consumers within 2 years, notably BERT for websearch.
  - umeshunni 3mo ago
    and Google Translate: https://arxiv.org/abs/1804.09849 https://arxiv.org/abs/1804.09849
leoh 3mo ago
Kind of makes you wonder if there are other papers from Google that are potentially also profoundly groundbreaking but overlooked
- whiplash451 3mo ago
  Groundbreaking includes the “explain to the world why it matters” part

npn 3mo ago

weird, for so long I'm damn sure that researchers are obligatory to release research papers to fulfill their quotas. otherwise they will lost their titles. so unless those companies (openai, anthropic) gave the researchers some fortune big enough to make them give up their research careers, they will keep publish research papers. aka it is not the good will of those companies.