3 ms·
This is nice and swell, but my experience with GPT-4 is that it lies. A whole lot. With style, I grant you, but blatant lies nevertheless. Specifically, when
by ur-whale 4y ago
This is nice and swell, but my experience with GPT-4 is that it lies.
A whole lot.
With style, I grant you, but blatant lies nevertheless.
Specifically, when you ask it to produce answers to factual questions that don't have an answer it learned on the internet, it just seem to flip to "generate stories" mode.
Specifically, when it produces factual answers (that are utter BS), if you ask it to provide a reference to its claims (a link), it just generates garbage URL's, none of which actually load, but all of which are actually extremely "plausible" (domain feels right, article title seems right, etc...).
When you corner it (it takes quite a while, because it keeps generating garbage for quite a few back-and forth interactions), it finally apologizes and advises you to go consult a more reliable source of information.
TL;DR: don't rely on answers provided by these things until:
- the "write a novel" mode that seems to be the default operating mode can be turned off hard (no lies please).
- answers come with a confidence score attached to it (which btw: when you ask for one, the damn thing proudly explains that it operates without these. I mean hell, even a four year old can tell you how confident he his when answering a question, including "I don't know").
- answers come with sources that don't actually produce a 404 when you try to read them.
I mean, I just spent an hour talking to something that felt like a total mythomaniac: when I asked it a somewhat obscure question about a topic in economics and asked for references, it when as far as inventing a book, complete with imagined title and author name. Neither author nor title could be found by all 4 major search engines I tried (yandex, duckduck, bing, and finally, google).
[EDIT]: don't believe me?
ask it to solve x^6 + x^5 + x^4 + x^3 + x^2 + x + 1 = 0 and read through the litany of BS is produces.
Telling it, for example, that one of the provided solution simply does not work when fed back into the original equation doesn't deter it in any way from producing yet another failed attempt at a solution, delivered with total aplomb.
- jazzyjackson 4y agoit is not an encyclopedia, it is a simulator, use it to simulate possible worlds instead of asking it questions about this one and you'll have a much better time it's a tool for thinking with, not a tool for thinking for you
- ur-whale 4y ago> it's a tool for thinking with, not a tool for thinking for you Says you. Oh, and something to consider: there's probably a reason why half of the internet thinks these things are the next generation search engines.