3 ms·
Analysis: ChatGPT is great at what it’s designed for. You’re just using it wrong
- SketchySeaBeast 4y agoThat does seem to be the most realistic interpretation of what ChatGPT can currently do. Given the time and energy sunk into it, though, that seems more than a little underwhelming.
- pixl97 4y agoTechnically we've invested far more in fusion energy and received far less back, yet I say we should push on with research. Some problems are just very difficult at the end of the day and require a lot of expensive disciplines working together.
- ruszki 4y agoThat’s true, however, Google also “lies” to you, and ChatGPT is quite good despite it’s not made for answering with facts specifically. It seems to me that it’s not worse averagely than Stackoverflow answers. Usually the right answer is something like what it gives, and after that a simple Google search usually get me the exact answer. This is good because Google can be terrible for example with Jakarta EE problems, but ChatGPT with some searching after that is waaay better.
- fullsend 4y agoIt feels like you immediately get on the right track and can refine it with no clutter whereas when you Google you may flounder for a bit before finding the path among the ads, bad blog posts, questionable StackOverflow…
- t0suj4 4y agoI've realized pretty quickly that it's weak at giving factual results. It's amazing at giving general answers and outlines though, ask it what you should take with you on a trip and it can give you something you wouldn't have thought of.
- thomastjeffery 4y agoThat depends on what you claim it is designed for. Most claims about chatGPT's behavior do not match its actual behavior. Let's consider the claim on chatGPT's home page: > The dialogue format makes it possible for ChatGPT to answer followup questions, admit its mistakes, challenge incorrect premises, and reject inappropriate requests. This statement is correct from the perspective of utility: ChatGPT does, at the end of the day, exhibit these behaviors successfully. But there's a problem here: utility isn't the perspective that the average reader is likely to infer with. In fact, they are expected not to! The expected perspective is ability. After all, we are talking about what ChatGPT is able to do. This is the most subtle, yet most important distinction. ChatGPT is, itself, entirely not able to do any of these things! But how then does it exhibit these behaviors? If it isn't doing the work, who is, and how (and where) does ChatGPT leverage that work? To answer that question, let's talk about what our expectations are for what "doing" means. Traditionally, to do a thing, you must identify the subject (the thing), and apply a verb (do). ChatGPT is explicitly capable of neither. ChatGPT does not recognize subjects. ChatGPT does not implement arbitrary behaviors from the meaning of verbs. Before ChatGPT can exist at all, let alone exhibit behavior, it must be trained on a dataset. Here's what that looks like: ChatGPT's neutral net is fed a stream of text. That text is tokenized into short groups of characters. This is our first divergence from expectation: why not tokenize words and punctuation? Because ChatGPT explicitly does not interact with words or grammar. It does something else entirely, and short groups of characters are a good structure for that thing. Next, the groups of characters (tokens) are organized as "neurons". So far, it's a graph without edges. Next, duplicate nodes are found and linked together. This creates the foundational model that will later resemble (but not be) a knowledge graph. Next, duplicate patterns of nodes and edges are recognized, and connected together. Same as the last step, just higher order. Our neutral net model is complete. Finally, the neutral net is trained. It's given a series of tests, each with an expected result. A successful test is weighted positively. At no point did we define categories like subjects, grammar, or verbs. We didn't even define words. What we did define is a model of how text relates to itself. And that's where the magic lies. What does text mean to itself? Literally everything. Words and grammar are the symbolic representation of ideas, and that representation is explicitly defined. The only reason that isn't enough on its own is that natural language is imperfect, and full of ambiguity. In other words, natural language lies to itself about itself. Humans compensate with logic and context. We explicitly define the meaning of text by building up to it with backstory (context), and when we are uncertain, we filter out any construction that isn't logical. By providing a dataset of text that was logically constructed by humans, modeling how that dataset relates to itself, and explicitly training a preferred continuation whenever a human recognizes a bad continuation, what we end up with is a fuzzy algorithm that implicitly maps the semantics of an expression to the most familiar semantic continuation. Because semantics are very nearly a 1-to-1 mapping from symbol to meaning, the emergent effect of this system very nearly mirrors the logic-based interaction of human writing. But every ambiguity that exists in language is also an emergent effect. It becomes a lie or a mistake. The logical relationship that was captured by symbolic representation when a human wrote it is broken. Natural language has lied to itself about itself. A human could recover, but ChatGPT must be explicitly trained. This is done either by explicit training (to define a preference/expectation), or by filtering the original dataset to be less ambiguous. Language itself can also recover, by providing explicit clarification after the fact. This is implemented often in technical writing. So what can ChatGPT do? Generate a semantically likely continuation from its training dataset. What can a semantically likely continuation be? Either a logically coherent response or a semantically coherent lie. How hard is it to guarantee the former? Extremely hard.