3 ms·
That's a chat gpt problem, if you hit the API it's not nearly so hard to get good output.
by CuriouslyC 3y ago
That's a chat gpt problem, if you hit the API it's not nearly so hard to get good output.
- refulgentis 3y agoI wouldn't say that, my latest big user story for making sure I'm handling huge inputs was "translate Moby dick to zoomer". Cant give any service chunks larger than ~5K tokens, over API, without it failing. (Miserably, like, I'd be fine if it gave a paragraph back. But at least on this "map" task, there's a critical point where there's so much input that the reward function ends up imitating the input more instead of chatting)