4 ms·
I have access to GPT-4 through both ChatGPT Plus and the API, and at this point I only ever use the API through a discord bot. 25 messages/3 hours is way too lo
by alpark3 3y ago
I have access to GPT-4 through both ChatGPT Plus and the API, and at this point I only ever use the API through a discord bot. 25 messages/3 hours is way too low of throughput for me, and imo many people underestimate how powerful the system prompt is. I've gotten much better results fiddling with the system prompt on top of regular prompt manipulation.
My theory(with zero evidence besides my intuition) is that although the underlying GPT-4 remains largely similar across different time points, OpenAI is actively manipulating ChatGPT's system prompt and god-knows how many different auxiliary settings behind the scenes. The API seems much more stable.