4 ms·
They're not actually processing the entire system prompt (which is rather long) on every query, but continuing from a model state saved after processing the sys
by vanviegen 2y ago
They're not actually processing the entire system prompt (which is rather long) on every query, but continuing from a model state saved after processing the system prompt once.
That makes it a bit harder, but still, spitting out the wrong date just seems like a plain old time-zone bug.