3 ms·
Having worked on developing a GPT-4 based product from the day we got access, which was quite early as a YC company, I would say it's the following: - GPT-4 is
by rogerkirkness 3y ago
Having worked on developing a GPT-4 based product from the day we got access, which was quite early as a YC company, I would say it's the following:
- GPT-4 is too slow, and GPT-3 is not powerful enough to be 'good enough'
- Therefore, a lot of 'the work' is coming up with UX magic to overcome this
- It just is not reliable enough for business applications (yet) without hardcore QA that is currently being invented and improved materially on a weekly basis
- Therefore, the progress is in the last mile stuff like productionizing, QA, UX idiom invention, and/or coaxing GPT-3 to be good enough and go fast enough
- All of what you're mentioning are LLMs, and GPT-4 seems likely the theoretical maximum LLM based on currently available knowledge
- No doubt some more powerful models are in the works, but then the same process repeats (e.g. assess capabilities, invent UX idioms, QA and wait)
So a conspiracy that incredible things are happening but no one is talking about it to me is not accurate. More like productionizing ChatGPT/GPT-4 is very early and putting new technology into use is always harder than it says on the label.
- redsfs34234 3y agoConspiracies are right ...and most of what's watchable from afar of the actual internal systems are just artificially, purposedly downgraded models. Like anyone playing with public (even paid), APIs, you're accessing only already deprecated software. These things are around from 2018, having reached production level circa 2020. So we - you - are seeing the past, 2020-2021 level technology, and internally they're working with 2023 level technology and playing with future AIs technologies. It's nothing new, this was already happening from 2018 onwards.
- Minor49er 3y agoReminds me of the famous quote that's often attributed to William Gibson: "The future is already here -- it's just not very evenly distributed."
- ChildOfChaos 3y agoI've never thought that GPT4 was 'slow', just prompt it all at once and let it do it's thing. The problem with GPT4 is scalability and cost, even chatGPT plus users are still limited and it's still fairly pricey for a chatbot.