3 ms·
So, I went down an interesting rabbit hole with this. Claude was willing to give me (correctly) 100 digits of Pi, but when asked to write some Python code to le
by lhl 3y ago
So, I went down an interesting rabbit hole with this. Claude was willing to give me (correctly) 100 digits of Pi, but when asked to write some Python code to let me confirm the digits of Pi, it failed over and over again (in different ways each time, interestingly enough). Basically, it's still wholly inadequate for coding.
Now, ChatGPT on the other hand... I shifted over to ChatGPT-4 Code Interpreter, and it gave me a working method (and of course was able to run the code directly) using mpmath the very first go, and then with BBP when asking for using just the standard library, and also via Leibniz as well, with the warning it would be slow, when asked for the shortest code. It was able to give me a chart of various known pi calculation methods and their relative speed/other properties, and then it refactored the code it had give me so far along with adding timings so I could see relative speed. Lastly, it helped me write the code for running Leibniz and timing the length for calculating each additional digit of precision, as well as projecting how long it would be to get to additional digits of precision (and how much precision I could get on my CPU at certain time periods). Lastly, I had it plot out how long it would take to get to 12 decimal places and it used matplotlib.pyplot to generate one for me. "As you can see, the time increases exponentially with each additional decimal place. Based on our estimates, it would take well over 100 years to compute."
I've yet to see any other service/model (open or closed) get close to doing what ChatGPT-4 + Code Interpreter is doing atm...
- CSMastermind 3y agoGPT-4 seems far and away the best model at coding. It's the only llm I've tested that can borderline pass a technical interview.
- TX81Z 3y agoIt’s my personal intern.
- rayxi271828 3y agoHow was it able to run the code directly for you? For me it said it didn't have access to external libraries.
- lhl 3y agoChatGPT isn't exactly aware of what packages it has available. If it says it can't, you can just ask it to nicely to try. Here's a list of what it has installed currently: https://github.com/petergpt/code-interpreter-packages/blob/main/packages_with_descriptions_Vfinal.md https://github.com/petergpt/code-interpreter-packages/blob/m... Note, you can also upload statically compiled libs/binaries, even tarballs into its execution environment. I'm not sure how sound that is from a security perspective, but people have been doing it lately (along with a lot of poking around).