3 ms·
From my understanding of language models it’s not truly possible for it to disclose a source. At best the result of a prompt can be correlated with a web search
by endisneigh 4y ago
From my understanding of language models it’s not truly possible for it to disclose a source. At best the result of a prompt can be correlated with a web search, but fundamentally that’s not really the same. It’s in a sense a coincidence, at best. The model has no ability to introspect its prompt result with the underlying tokens that were in the training set.
Imagine some godly AI. You ask it who the President of United States is today. It says Biden. It sources the White House site. Easy enough. You ask who the president will be in 2025. It returns a result. Ultimately no source could properly justify the claim it makes, unless the result itself was probabilistic. At the same time, it’s possible, with enough data for you to predict with extremely high likelihood who the President will be in 2025, now (current polling techniques don’t have this precision, but it’s possible some later iteration of a language model to predict a result more effective than all ping models today).
- zoklet-enjoyer 4y agoSounds like they just want to know what it was trained on.
- deleted 4y ago[deleted]
- endisneigh 4y agoFrom reading the AI act, which is being referred to, it seems to be more than just that. In particular Article 29, which discusses the ability of the user to test for conformity, which the act defines as compliance with the rules set in the act, which include accuracy and robustness transparently communicated to users. What could that possibly mean other than proveance in the context of a LLM? The only other way to comply would be if OpenAI simply released the entire training set and steps to derive output from it. In this case that would mean the weights and underlying training algorithm. No chance that happens.
- ChatGTP 4y agoNo chance that happens. Why not ?
- endisneigh 4y agoyou don't see why OpenAI would not give users the weights and specific algorithm necessary for training?
- ChatGTP 4y agoWhy wouldn't they ?
- Mike_12345 4y agoYou are confused. The EU is proposing that the developers should disclose the sources of training data. That is explained in the first sentence of the article. They're not requiring the language model itself to disclose the sources.
- endisneigh 4y agoI'm not talking about the article, I'm talking about the EU Act which the article references.