3 ms·
there absolutely are ways to cache common-routes to fields of commonly requested paths. (hint : it's not all regex and checksums.)
by serf 18d ago
there absolutely are ways to cache common-routes to fields of commonly requested paths.
(hint : it's not all regex and checksums.)
- dimitri-vs 18d agoOk I'll bite, how do you reuse the answer to "what color is the sky?" while also layering in memory, custom system instructions and custom response styles?
- zamadatix 18d agoIt's probably only memory that'd need an answer for some form of caching to be worthwhile (though I'd be curious what that answer is) since memory is on by default and rarely identical between users. The rest are nice to haves, but not everyone customizes settings just because they are there so there will be some large pool of users with the defaults who could hit cache without them.