4 ms·
> get this question correct I am willing to bet a million dollars that it is unlikely any single model will ever be able to answer any question correctly. The
by andsoitis 3y ago
> get this question correct
I am willing to bet a million dollars that it is unlikely any single model will ever be able to answer any question correctly.
The implications then are that one cannot use a single question evaluate whether a model is useful or not.
- smilliken 3y agoOf course that has to be the case otherwise you have a halting oracle. It's fitting this was proven by the namesake of the Turing Test.
- xsmasher 3y ago"I don't know" is more correct than making up an answer.
- koonsolo 3y agoWith ChatGPT I sometimes prompt "also indicate how certain you are that your answer is correct". Works pretty good actually.
- nomel 3y agoI've had very good luck with a follow up "Is that answer correct?"
- sebzim4500 3y agoThat's not the training objective though. It's like doing exams in school, there is no reason to admit you don't know so you might as well guess in the hopes of a few marks.
- jacquesm 3y agoIf so then that means the training objective is wrong because admitting you do not know something is much more a hallmark of intelligence than any attempt to 'hallucinate' (I don't like that word, I prefer 'make up') an answer.
- famouswaffles 3y agoI guess the brains objective is wrong then seeing how much it's willing to fabricate sense data, memories and rationales when convenient
- jacquesm 3y agoThe brain wasn't designed.
- famouswaffles 3y agoThe brain is the result of maximizing biological objective functions. Since that led to something that fabricates a lot of things very often, saying the objective function of an LLM is "wrong" because it also fabricates is nonsensical.
- jacquesm 3y ago> The brain is the result of maximizing biological objective functions. That's not how evolution works at all.
- famouswaffles 3y agoa mutation happens and if that mutation succeeds in ensuring survival, it stays and then spreads. Reproduce is a function evolution maximizes for. Not intentionally sure but that's irrelevant. The whole point of artificial neural networks is that they teach themselves. They get an answer wrong, numbers shift and if those numbers help the next instance they stay or shift as needed. There's no intentionality in the shifting numbers either.
- deleted 3y ago[deleted]
- deleted 3y ago[deleted]
- aidenn0 3y agoThere are plenty of exams that give either partial credit for "I don't know" or negative credit for a wrong answer (to discourage guessing). Training on internet comments is going to make "I don't know" rather unlikely because when someone asks a question in an online forum and I don't know the answer, people will just not respond rather than responding "I don't know"
- jacquesm 3y agoIndeed.
- nvy 3y ago>any question Do you mean "every question"? Because ChatGPT has already answered some of my questions correctly, so if you mean "any" as in "any one of the infinite set of questions" I'll take that bet.
- b33j0r 3y agoI got that question wrong, I still have no idea what the correct answer would be. That is extremely obscure. Any intelligence or simulation might try to guess at an answer to that third-level-of-hell interrogation. “Why was Spartacus filmed in California near pizza noodle centurions?”
- jacquesm 3y agoYou could of course also answer 'I don't know' which to me is a correct answer, far more so than something you made up.
- b33j0r 3y agoThat would make it a more reasonable human. But it’s actually a compendium of everything you and I and shakespeare and the january 6th viking have penned. The creativity, which we call hallucination, is the advantage of the approach. If I wanted a search engine for actionable facts, they have worked pretty well for 30 years.
- atonse 3y agoI'd struggle to find any humans that understand that question without going "huh?" I've read it 3-4 times and it still doesn't make sense towards the end. So why would we expect these models to make sense of them?
- yodsanklai 3y agoI would go even further, use models to answer questions only if you don't care whether the answer is correct or not.
- andsoitis 3y agowhat is the use case for that approach?
- yodsanklai 3y agoany answer that you can check easily: generated code that you can test, text summary/rephrasing. Or questions for which answer aren't critical/objective ("how to procrastinate less").