4 ms·

Glad to hear this, indeed we think there's opportunity for some more cutting edge tooling in the TS ecosystem. We absolutely want to add a caching layer. Actua

Glad to hear this, indeed we think there's opportunity for some more cutting edge tooling in the TS ecosystem. We absolutely want to add a caching layer. Actually, we think middleware is where a lot of the value of the framework will come: it enables a whole bunch of features, e.g. sending errors to datasets for labeling, caching, user throttling, analytics, A/B tests, ... We're likely going to build the serving module next which will cover this.

jumploops 3y ago
Very cool. To be completely candid, we just hit OpenAI directly, no 3rd party libs involved at the moment (just fetch). We're open to trying more TS-focused libraries, but definitely more hesitant after our initial experiences with other libs. The less magic the better (no hidden prompts, etc.).