6 ms·
I want to use this comment to state one thing, not directly addressed to you. Stop using GPT as a database! GPT is far more useful a reasoning engine that can
by LASR 3y ago
I want to use this comment to state one thing, not directly addressed to you.
Stop using GPT as a database! GPT is far more useful a reasoning engine that can accumulate fuzzy data and then provide various views or transformation of that data.
So asking GPT to parse a Wikipedia page and then asking it to teach you from it - this is a much more successful usage than what the author in the original article is doing.
It is not useful as an accurate source of information. It’s inaccurate sometimes, and it’s hard to tell when. OTOH, as a formatted, it has some actual world-changing potential.
- hammyhavoc 3y agoIs it? I couldn't even get it to figure out an NGINX config, despite feeding it the documentation and URL rewrites it would need, and the prior Apache .htaccess file. Spent days on it. Consulted with people who know more than me about prompt engineering. Nope. Reasoning is not its strong point, IMO. It's a next-word prediction model, why would it be? It's doing what an LLM does. Frequently, nonsensically.
- LASR 3y agoInteresting. Curious as to what specific task you gave it and how it failed. My team has been working on several advanced techniques using reasoning on LLMs. The stacked performance of all of these techniques combined yields is quite impressive.
- andai 3y agoGPT-3 or 4? Re: reasoning, apparently it gives much better performance if you ask it to write out its thought process step by step (because it has no "internal" thought process; it must be externalized).
- simonw 3y agoYeah, that sounds like a GPT-3.5 problem to me. I wouldn't trust 3.5 to write me an Nginx config, but I'd give 4 a shot at it. I just tried using GPT-4 to translate a random htaccess file I found to nginx and it seemed to do a good initial job: https://gist.github.com/simonw/8174f653a0c08c120830c56332054ca3 https://gist.github.com/simonw/8174f653a0c08c120830c56332054...
- andai 3y agoI tried your prompt and it works with 3.5 too, but I'm not qualified to verify the output (75% of it looks the same to me though).
- throwaway675309 3y agoI've actually had great success with the automation of boiler plate DevOps nonsense using GPT-4, including: GitHub actions, Caddy scripts, Docker files, etc. Every second that I didn't have to: - go look up a similar problem on Google - open three or four stack overflow tabs - read through the stack overflow links - copy out the answer - change all the variables to match variable names that I want All of this represents a huge time saver for me. I'm honestly baffled that people lack the ability to use LLMs in a productive and optimal manner.
- consp 3y agoDid you learn anything in the process? You'd still have to over the output and understand it, otherwise nothing has changed except the method of producing something you don't understand.
- rolisz 3y agoIf you're not DevOps, why bother learning whatever framework is used today, but which will be replaced by something else next year? I just want to get my stuff deployed and that's it.
- ChatGTP 3y agoYeah that’s true, why bother actually knowing anything about the systems they run your software /s
- rolisz 3y agoI have a finite amount of time. I can choose to learn and know more about the software that I'm developing and make the software better, or I can spend some amount of time to learn the DevOps part, or some mix in between. In some cases, the ratio is 90:10 in favor of software development.
- ChatGTP 3y ago
- SanderNL 3y ago> It's a next-word prediction model, why would it be? If you want to make accurate predictions, you'll need reasoning or at least some process that approximates it. "There a no bananas. Max is looking for bananas. Will he be successful: [yes/no]"
- deleted 3y ago[deleted]
- burnished 3y agoInteresting! I found it super helpful with gitlab-ci stuff and docker, as well as much bash and makefile stuff. I would have assumed it would handle NGINX configurations. Tbh, it isn't surprising that it fails, its surprising that it has subjects where it is very useful.
- dmd 3y ago> It's a next-word prediction model So are you. https://ceoln.wordpress.com/2023/03/31/its-just-predicting-the-next-word-well/ https://ceoln.wordpress.com/2023/03/31/its-just-predicting-t...
- gbjw 3y agoMaybe you are, but I'm not :).
- hammyhavoc 3y agoAnd your qualifications and background are what? Why is this on a free WordPress instead of in a scientific paper if it's something to take seriously? Counterpoint: https://the-decoder.com/why-large-ai-language-models-dont-lead-to-human-like-ai/ https://the-decoder.com/why-large-ai-language-models-dont-le...
- dmd 3y agoDo you think I wrote that? And what do qualifications have to do with anything?
- hammyhavoc 3y agoI assumed you did, as it's a very strange post to link to on a very strange blog, and doesn't lend credibility to the idea that a human being is an LLM simply by existing, and if it was such a compelling idea then it wouldn't be languishing on a free WordPress. Qualifications are a great way of figuring out who's worth listening to, but that's not always the case as AI/ML folks prove with regularity, but it's nice to know if someone isn't just an armchair commentator and isn't peddling baseless information.
- dmd 3y ago> a human being is an LLM simply by existing, That's not what it's claiming at all. It's taking umbrage with the word "just" in "just predicting the next word". A gun "just moves some metal from one place to another".
- mlboss 3y agoAre you using GPT 4 ? It is far superior when compared to GPT 3.5
- vaidhy 3y agoI will paraphrase Geoff Hinton here - Predicting next word requires understanding context. Otherwise, you cannot predict the next word. It is a big deal.
- krainboltgreene 3y ago> GPT is far more useful a reasoning engine Hilarious to read this advice when GPT, by it's own designers, cannot reason.
- LASR 3y agoIt can’t reason - as in there no internal memory or intelligence in there. But you can ask it to generate a reasoning chain as part of its output. And then extract that output and do something else with that. That’s the reasoning it can perform. Look up the Sam Altman podcast with Lex. He specifically talks about reasoning engines.
- jiggawatts 3y agoThere is an internal memory, but it's very short lived, like a register in a traditional CPU architecture. It's like a CPU disconnected even from L1 cache, let alone RAM. I like to think of consciousness as not the substrate, but the information flowing through it. Not the H2O molecules in a river, but the current. We're like eddies and swirls in mountain streams, our thoughts are the patterns of flow, not the unmoving rocks that set them up. In this sense, when an LLM like GPT produces output, it's like a loop that has been cut, a single pass through what would be a circular process in a human brain. It can take a fixed number of steps from a standing start, but no more. This is because there is information flowing through it, transformed step-by-step. It just doesn't recirculate, it always exits after a fixed number of steps. Think of an unrolled for loop that always exits. It takes a few steps, which look like a loop, but can never actually iterate.
- burglins 3y agoI'm curious - how do you pass the article to GPT? Are you doing any formatting?
- nathan_compton 3y agoI gave it a ten page document a few weeks ago and it could not answer questions coherently from it. I find GPT4 useful, but I still feel its wishful thinking to call it a reasoning engine. It is, in the end, a giant model for predicting the next word in a corpus which you condition with inputs. I find it most useful to think of it as exactly that.
- QuantumGood 3y agoI asked it give me specs for a well-known microphone. Over the course of several queries, it gave three different numbers for the requested spec, none of them matching what the manufacturer gave on their website.