4 ms·
The proprietary offering does come with moderation built-in to some extent but that is not the same thing as saying that it will lie. An open GPT model will jus
by CyrsBel 3y ago
The proprietary offering does come with moderation built-in to some extent but that is not the same thing as saying that it will lie. An open GPT model will just focus on what the training data informs it of, and as the training data improves its description of how the world works will become more precise. You can ask ChatGPT for sources and to show work. Will it hallucinate from time to time? If the data is incomplete or there are gaps in information flowing to ChatGPT, yes. That is nowhere near the same thing as straight up being told the wrong information by human beings knowingly.
The reason this is relevant is because the reply up above said we don't need LLMs or GPT-4 for what I mentioned about rapid learning sans bloated bureauracy and lying bureacrats. This is way more common and likely in the existing world, particularly since humans have incentives to lie and are protected by the false light of a bureaucracy that is more interested in its own preservation instead of allowing itself to be obviated by new tech.
- paulryanrogers 3y agoThen one must trust the training data is not polluted by human lies
- CyrsBel 3y agoIndeed. But requiring data, source code, and weights on papers submitted for peer review would solve a lot of this. As well as making data sets and data collection processes reproducible and open such that anyone can verify it end to end. LLMs can be open and set up such that they curate this for people too. You know how AWS has a status page for availability? We could have status pages for LLM data training set integrity. It will be way more manageable and truthful this way than in the existing way where some European bureaucracy (disclaimer: I am European) sits in front of my and your access to GPT-4 or an LLM running on our boxes directly.