4 ms·
> Is OpenAI still making any changes to make ChatGPT better and more accurate and correct a few prompts recently, it just answered for me instead of refusing,
by fragmede 2y ago
> Is OpenAI still making any changes to make ChatGPT better and more accurate and correct
a few prompts recently, it just answered for me instead of refusing, to my surprise, so if feels like it's been getting better, but unfortunately there's no hard data I have on that, it's more of a feeling, so it's hard to prove that's actually true to someone else.
then again, ChatGPT-4o was recently found to be unable to do 9.11 - 9.9 correctly unless pressed, so there's still a long ways to go.
https://chatgpt.com/share/47d260ae-0c62-48ab-8d3b-84767acd7fb5 https://chatgpt.com/share/47d260ae-0c62-48ab-8d3b-84767acd7f...
- JohnMakin 2y agoThat is interesting for sure, but the subsequent questioning "Why did you get it wrong the first time?" and asking it to explain itself seems like it shows a misunderstanding about how these technologies actually work. Please stop treating these tools like they are conscious and actually understand what they are spitting back to you! /rant
- fragmede 2y agoI've done spreadsheets are all you need. The questioning isn't based on a misunderstanding that this is autocomplete with an insane dataset, but given a black box, how else do you want it to explain how it works?
- JohnMakin 2y ago> how else do you want it to explain how it works? Why do you think these tools understand how they work enough to explain it? If this were the case they wouldn't be a blackbox to begin with.
- Atotalnoob 2y agoBecause it’s making up how it works.
- skeledrew 2y agoActually, given that models are trained on data generated by humans, the ideal way to get decent responses are by treating them as such. Many times when I'm aware that a model gave an incorrect response, or I'm not sure and skeptical, a simple "Are you sure" or "Explain your answer" does wonders.
- tempodox 2y agoLLMs are text completion engines and can't really do math. Even if it happened to know the correct answer to 9.11 - 9.9, it could still fall flat on 9.12 - 9.9.
- cableshaft 2y agoIf it doesn't already (doesn't seem like it does last time I checked), it could potentially recognize that as a mathematical equation and feed that portion of the query into a calculation engine, and then include that in its answer.
- pseudosavant 2y agoIt is interesting that one of the best ways to deal with math problems in LLMs is to have it write Python code to solve the problem. It is good at writing that kind of fairly straight-forward Python, and Python is good at accurately being able to do math. It does mean that you need to safely implement a sandboxed Python interpreter to do the calculations though.
- visarga 2y agoAs a human you can hardly catch me doing a math calculation by hand. Almost always use calculators.
- jononor 2y agoCompanies like Cohere are focusing a lot on this. It is a bit surprising if OpenAI does not already do it?
- Terretta 2y agoThis is from current ChatGPT 4o: Q: Write parameterized Python that gives the answer to 9.11 - 9.9 and 9.12 - 9.9. Run the Python to show the answer to each pair of parameters. A: The results for the parameter pairs are as follows: - 9.11 - 9.9 = -0.79 - 9.12 - 9.9 = -0.78 [>_] The [>_] is a link. Clicking it opens a pop-up window, showing: def calculate_difference(a, b): return a - b # Define the pairs of parameters pairs = [(9.11, 9.9), (9.12, 9.9)] # Calculate and print the results for each pair results = {f"{a} - {b}": calculate_difference(a, b) for a, b in pairs} results Result: {'9.11 - 9.9': -0.7900000000000009, '9.12 - 9.9': -0.7800000000000011} // Note, if I ask it simply "compute the answer to 9.11 - 9.9", I get nonsense such as a negative number, and no Python. It doesn't "automagically" write code, it has to be nudged. If you see "Analyzing", it's fired up a sandboxed Python container.