3 ms·
There are only a handful of firms that can produce results to this level and they are presumably logging everything their model produces. Eliminating text that
by mike_hearn 4y ago
There are only a handful of firms that can produce results to this level and they are presumably logging everything their model produces. Eliminating text that was produced by their model from the training set would be easy.
Now, if the tech reaches the point where there are thousands of firms offering free access to the models and they aren't co-operating to share logs then yes. But we have no idea how expensive or hard ChatGPT is to run. It might be a Google-type situation where only one or two firms in the world can build and run competitive chatbots.
- anon7725 4y agoI don’t think it’s a race to build the best/cheapest model for public consumption. Someone is going to build or renovate a law firm/enterprise software company/investment bank/medical expert system/etc around this technology. Perhaps it will be a joint venture between tech companies and subject experts. It’s possible for each executive to have a mentat who can whisper to the machine instead of a department of programmers/middle management/ops people/accountants/lawyers/etc. Doesn’t seem so far-fetched after a day of playing with this system.
- mike_hearn 4y agoWe'll see. Most people in any industry don't want to be reduced to the role of just fact-checking a professional BS generator. It'd be terrible for morale and not obviously more productive, given that any time the user even suspects an answer might be wrong they'll have to do significant skilled research work to fact check it. Unless you get the untruthfulness problem down to a small percentage of the output you could easily just create negative value there, sort of like how poor programmers are sometimes described as producing negative for their team because others have to run around correcting their work.