3 ms·
The reality is also that the "holy shit" moment around LLMs seems to have largely passed. Models are incrementally improving, sure, but the fundamental limitati
by alfalfasprout 3y ago
The reality is also that the "holy shit" moment around LLMs seems to have largely passed. Models are incrementally improving, sure, but the fundamental limitations are here to stay (at least for now). That means a long tail of adding guard rails, etc.
At the end of the day, the value add is also around integration and implementation and that is very difficult to generalize.
- beebmam 3y agoI don't think so. Very few people I've spoken with have used GPT-4, even engineers. GPT-4 is light years ahead of GPT-3.5
- mcny 3y agoThe people who have used GPT-4 seem to unanimously agree that the GPT-4 today is not the same as GPT-4 as released. Open ai is clearly holding back...
- OO000oo 3y agoI’ve noticed that answers have more filler and useless politeness now, but I probably don’t use it enough to notice more than that.
- pclmulqdq 3y agoGPT-4 has been entirely unimpressive to me. I first used it 3 months after launch, when they had already degraded the quality significantly, and there was no "magic" moment. LAMDA (internal to Google) was actually the last time I had that sense of AI wonder, and since then, the GPTs are basically only incrementally better. Edit: fixed the number - I thought it launched in January. It turns out late March was the launch, while the first hints/discussion about it were January. I got around to it in early July.
- TulliusCicero 3y agoThere's plenty of holy shit moments left to develop I think. For example, it's relatively straightforward to generate dialogue or other text for a game, but structurally connecting any of that text to game mechanics is unsolved (though AI Roguelite is trying).
- fullshark 3y agoSounds like implementation and integration? Also how do you invest in that? Are video game companies going to offload dialogue generation to a firm that charges a license fee on every bit of dialogue generated?
- TulliusCicero 3y agoWell, the bigger ones could probably afford to take an existing open source/free model and fine tune it for their use case with more training. Then run it themselves in some cloud (they already have some experience with servers after all). Many users' GPU's are powerful enough to run models locally, but the rub there is that you can't really run the model at the same time you're playing the game normally, unless you want, like, massive frameskips.