5 ms·
Hey - three reasons I thought this could be interesting / useful: 1. Serverless functions timing out with high latency or elongated completions + DB calls. 2.
by baetylus 3y ago
Hey - three reasons I thought this could be interesting / useful:
1. Serverless functions timing out with high latency or elongated completions + DB calls.
2. Edge funcs not being sufficient, esp if you're batching together requests
3. Devs spinning up their own simple express servers to handle requests and reinventing the wheel with rate-limiting, retry-logic, and webhook configuration.
Thruway could be an open source library for handling these problems and simplify integrating AI. Thoughts?