3 ms·
You will still need the compute resources of Microsoft, Meta etc. And they have their own people who equally know how LLMs work. Even raising funds is not a c
by threeseed 2y ago
You will still need the compute resources of Microsoft, Meta etc.
And they have their own people who equally know how LLMs work.
Even raising funds is not a certainty given that VCs are becoming more cautious with AI as they realise it's now a platform fight between the mega corporations.
- freshpretzels 2y ago> You will still need the compute resources of Microsoft, Meta etc. 2-3 years ago sure, but now? Maybe he knows how to reduce that need by order of magnitude.
- vanjajaja1 2y agoyep, and the puzzle isnt 'make chatgtp again' its 'catch up to chatgpt' which is a whole other puzzle
- zeroCalories 2y agoPlenty of companies have compute, but everyone is barely catching up to GPT-4 over a year after release. I'm sure places like Meta would love to unlock the details of what makes it so good.
- CuriouslyC 2y agoThere's no mystery, they just have a lot of actual user data, so they've been able to refine the question answering behavior. They've also baked some common problem solving strategies like chain of thought into the model via training.
- ignoramous 2y ago> Even raising funds is not a certainty given that VCs are becoming more cautious You'd think any investor would be utterly stupid to not make an exception for Ilya, regardless.
- callalex 2y agoThat’s not such a given. There are a toooon of deep pockets in this space already and absolutely zero path to profitable products for any of them.