4 ms·
That is, these companies are largely not doing the hard part, which is creating and training these models in the first place. No, there is no real "hard part"
by joe_the_user 4y ago
That is, these companies are largely not doing the hard part, which is creating and training these models in the first place.
No, there is no real "hard part" to AI current. Training is simply "the expensive part".
It seems "the bitter lesson" has gone from reflection to paradigm[1] and with that as paradigm, the primary barrier to entering AI is cash for cpu cycles, other things matter but recipes is relatively simple and relatively available.
[1] http://www.incompleteideas.net/IncIdeas/BitterLesson.html http://www.incompleteideas.net/IncIdeas/BitterLesson.html
- zwaps 4y agoI get your point, but please do read the training logs for Meta's OPT, it's some Greek drama I tell ya
- shostack 4y agoWhich checks the box for great timing. All these companies with billions in the bank needing a new thing to prove they still warrant their growth valuation will dump obscene sums into this and cause things to evolve at a staggering pace, much like we've seen with AR and VR.