6 ms·
> Seems to me that it's the team + market that won the money. That's pretty much it. Most analysts expect there's an addressable market of $20bn this year, gro
by Shrezzing 3y ago
> Seems to me that it's the team + market that won the money.
That's pretty much it. Most analysts expect there's an addressable market of $20bn this year, growing to $100bn per year by the end of the decade. The market will be split between four or five companies. The number of people globally with the required expertise to create these models is in the tens (generously one hundred individuals). Three of those people are involved in this company now, and another five are joining in the next few weeks, each leaving senior positions at competitors.
This one company has secured something in the order of 5-10% of the global talent pool for a $100bn/yr industry.
- user_named 3y agoI don't at all believe the people able to build models are that few. Aren't tons of people doing open source models already? I believe the number of people who have already built models to be low, but the number of people with the capability to build models to be very large. It's not magic.
- whiplash451 3y agoThe number of people who can actually pre-train a true LLM is very small. It remains a major feat with many tweaks and tricks. Case in point: the 114 pages of OPT175B logbook [1] [1] https://github.com/facebookresearch/metaseq/blob/main/projects/OPT/chronicles/OPT175B_Logbook.pdf https://github.com/facebookresearch/metaseq/blob/main/projec...