3 ms·

Depends what the topic is. IME it hallucines rarely when asked practical programming questions but basically constantly when asked math questions beyond basic

Depends what the topic is. IME it hallucines rarely when asked practical programming questions but basically constantly when asked math questions beyond basic calculus.

mirsadm 2y ago
It constantly invents functions that don't exist.
- timnetworks 2y ago
  Deal with it like Wolfram, implement those functions! It's picking up on something. :D
TheNewsIsHere 2y ago
The more abstract or nuanced something is, the less capable it seems to be unless you have a domain specific LLM trained on a corpus of quality data. As a business owner with both applied experience and formal education on both the tech and the business sides, I wouldn’t trust random LLM-generated advice on business. There are nuances and a certain humanity in good business that an LLM is unlikely to pick up. And the Internet is filled with horrible advice and useless insight on running a business that it can’t distinguish from good advice and valuable insight. My advice to anyone seriously considering a business is that a course or reading a good survey text on business will pay off in ways that ChatGPT can’t (yet?) give you.
dvfjsdhgfv 2y ago
It might be just a glitch but in the last few days it generates such blunders I suspect something must be going on. Like completely messing up random pieces of code on subsequent iteration. I don't remember anything like this before. Normally it would improve the code with each iteration (until going out of the context window and starting to "forget" things, but not putting random characters here and there on second reply).
- Jensson 2y ago
  Likely you are just moving slightly outside of its knowledge domain with your questions. Anything that is hard to Google will also typically generate bad responses, most coding problems are there but many programmers just work on the few common problems over and over.

Depends what the topic is. IME it hallucines rarely when asked practical programming questions but basically constantly when asked math questions beyond basic calculus.

mirsadm 2y ago

It constantly invents functions that don't exist.

timnetworks 2y ago
Deal with it like Wolfram, implement those functions! It's picking up on something. :D

TheNewsIsHere 2y ago

The more abstract or nuanced something is, the less capable it seems to be unless you have a domain specific LLM trained on a corpus of quality data. As a business owner with both applied experience and formal education on both the tech and the business sides, I wouldn’t trust random LLM-generated advice on business. There are nuances and a certain humanity in good business that an LLM is unlikely to pick up. And the Internet is filled with horrible advice and useless insight on running a business that it can’t distinguish from good advice and valuable insight. My advice to anyone seriously considering a business is that a course or reading a good survey text on business will pay off in ways that ChatGPT can’t (yet?) give you.

dvfjsdhgfv 2y ago

It might be just a glitch but in the last few days it generates such blunders I suspect something must be going on. Like completely messing up random pieces of code on subsequent iteration. I don't remember anything like this before. Normally it would improve the code with each iteration (until going out of the context window and starting to "forget" things, but not putting random characters here and there on second reply).

Jensson 2y ago
Likely you are just moving slightly outside of its knowledge domain with your questions. Anything that is hard to Google will also typically generate bad responses, most coding problems are there but many programmers just work on the few common problems over and over.