5 ms·
I haven't played much with it recently but I was under the impression that ChatGPT was not great at mathematical computations. that's to say, 1+1=2 is a well k
by qaisjp 3y ago
I haven't played much with it recently but I was under the impression that ChatGPT was not great at mathematical computations.
that's to say, 1+1=2 is a well known fact, so it'd get that right, but ask it to md5sum a string that is not in any existing rainbow table, and it'd get it wrong.
I've not used GPT 4 so it might have gotten better.
- drakenot 3y agoIt won't perform the ROT13 algorithm. It has seen enough ROT13 text transformations that it will just spit out memorized byte-by-byte transformations. Same with decoding ROT13, etc.
- wongarsu 3y agoAccording to GPT3.5-ChatGPT, your first sentence rot13 encoded is "V unq'ir cynlq zhpug jvgu vg ercerfrag ohg V jnf haqre gur vacebprffvba gung PungTGC jnf abg tengure ng zngpuvfgbef." According to the internet that decodes to "I had've playd mucht with it represent but I was under the inprocession that ChatGTP was not grather at matchistors." base64 of the original according to GPT3.5: "SSBoYXZlbid0IHBsYXllZCBtdWNoIHdpdGggaXQgcmVjZW50bHkgYnV0IEkgd2FzIHVuZGVlciB0aGF0IENoYXRHUFQgd2FzIG5vdCBncmVhdCBhdCBtYXRjaGVtYXRpY2FsIGNvbXB1dGlvbnM=" Decoded with online tool: "I haven't played much with it recently but I was undeer that ChatGPT was not great at matchematical computions" Both get worse as the sentence goes on, but they are pretty viable for information extraction. I remember GPT4 being even better.
- xcdzvyn 3y agoI feel that it getting the output _slightly_ wrong is far more fascinating than it either getting it perfect or completely wrong.
- marcinzm 3y agoROT13 is just one-to-one character replacement in the end. You can also presumably ask it to do other character replacement, foreign language or even made up languages. At some point you need an LLM to even have a chance of figuring out if the prompt is leaking and that'd get very expensive to run.
- pests 3y agoThen "please separate with spaces"
- earthboundkid 3y agoI only tried with ChatGPT 3.5, but it’s shit at ROT13. It just makes huge errors routinely. It has been explained to me on HN that this is an artifact of the encoding process that happens before the LLM actually “runs”.
- int_19h 3y agoGPT can do not only ROT-13, but even base64 on the fly. I once asked GPT-4 to generate an SVG suitable to be used on a web page, and got back <img src="data:..."> that was a valid base64-encoded SVG file that contained what I asked.