4 ms·
The best technology doesn't necessarily win. First to market matters, especially when models on the scale of gpt-4 cost 100mln to train.
by __loam 3y ago
The best technology doesn't necessarily win. First to market matters, especially when models on the scale of gpt-4 cost 100mln to train.
- evilantnie 3y ago"best" is subjective, but I do think the industry will eventually converge onto an architecture that is significantly more cost effective than current state of the art. Regardless of who is first to market, everyone is incentivized to continue down this path with their research on improving LLM performance.
- realusername 3y agoWhile the first mover advantage exists, I don't think it's a sufficient moat in the long term. OpenAI's moat is the high cost of training as you mentioned but this might be obsolete in a few papers down the road. They themselves realized this by trying to turn it into a platform but I don't think it's enough.