4 ms·
Doesn't the section where the author goes through the LLM completely fabricating or confounding different parts of scripture give you pause about the truthfulne
by rtkwe 2y ago
Doesn't the section where the author goes through the LLM completely fabricating or confounding different parts of scripture give you pause about the truthfulness of the responses?
- verdverm 2y agoHow do we know the truthfulness of the original text that was written hundreds of years after the words were originally spoken?
- rtkwe 2y agoIt's asked about what a specific version of a text says and gets that wrong. It doesn't particularly matter how correct or carefully copied that scrap is, the machine can't faithfully reproduce or quote a particular version. In fact it made up a quote that doesn't exist in any version of the Bible the author could find at all.
- verdverm 2y agoa machine could, this machine cannot I was more trying to add an interesting philosophical perspective than to comment on this particular instance
- rtkwe 2y agoAs we build and understand them now there's pretty good structural reasons to believe that LLMs cannot be tweaked or tuned to be more than incidentally truthful.
- verdverm 2y agoIf you use an LLM only solution, sure, but there are many more opportunities if you expand the system to include more. We could, for example, use the existing tools for copyright detection, on the output and refuse to send it to the client side. It's just another moderation check in that perspective
- rtkwe 2y agoCopyright protection software is notably bad because it requires human context and decisions to decide infringement from fair use. Say we ignore that part that's the lowest hanging fruit on the improving generative models tree. Deciding if something is true to have the bot not say output it if it isn't is waaaay harder and the thing needed to fix the problem we've actually been talking about.
- jimbokun 2y agoIf you are asking that question seriously check out the recent Rogan podcast with Wesley Huff. Has the usual Rogan conspiracy theory pontificating, but also some good discussion about the history of how we got the Bible we have today. First off, the claim that the original text was first written 100s of years after the words were spoken is completely false and isn’t taken seriously by anyone in the field.