3 ms·
I’m building an open-source project (with a hosted option) that lets web and mobile devs add LLM-powered features with zero backend code. Current platforms like
by mkw5053 1y ago
I’m building an open-source project (with a hosted option) that lets web and mobile devs add LLM-powered features with zero backend code. Current platforms like Vercel still require at least a backend serverless function even for basic LLM integrations. This handles key management, access control, usage tracking, rate limiting, message conversation state, etc so devs can focus on frontend.
- ianbicking 1y agoWhere does stuff like the prompts go? If you put them in the frontend then you have a bit of a security, monitoring/etc concern. If you don't put them in the frontend... then you have a backend. (But maybe a simpler backend for devs to work with.)
- mkw5053 1y agoWe provide a fully managed, secure, and ready to use backend. You don’t have to develop, deploy, host, scale. It’s essentially “backend-in-a-box” for AI apps.
- ianbicking 1y agoYeah but you didn't actually answer the question...?
- mkw5053 1y agoPrompts (like system instructions) are stored and secured entirely on the backend we've built (and optionally host/manage). Your frontend never holds sensitive prompts or API keys, only the dynamic user inputs are sent to our backend, which then constructs and forwards the complete request to the LLM.