3 ms·
You've got a limited context window (for now). There's only so much you can put into a prompt, so how much you can teach it this way is going to be pretty limit
by skybrian 4y ago
You've got a limited context window (for now). There's only so much you can put into a prompt, so how much you can teach it this way is going to be pretty limited. Whatever you teach it had better be the primary task you're using it for.
You can't do it for everything, but if you can generate code and run it outside the LLM, you should.
- thebestgamers 4y ago[flagged]
- famouswaffles 4y agoThe limits of the context window become much less important (but can still be a problem I agree) when crucial context can be dynamically inserted only when relevant. Gpt-3.5 doesn't need the algorithm prompt for every single query. It just needs it for every query that requires arithmetic. Much more feasible.
- skybrian 4y agoIt seems like most of the time, a calculator plugin would do a better job, though? When would it make sense to have it reason it out itself?
- famouswaffles 4y agoIt wouldn't make sense for arithmetic, i agree. I was more thinking about other kinds of problems.