4 ms·
Question: Why do so many people ask if it's needed "24/7"? I've been on 2 calls this week where someone asked about my project "Do you need it available 24/7?"
by _akhe 2y ago
Question: Why do so many people ask if it's needed "24/7"? I've been on 2 calls this week where someone asked about my project "Do you need it available 24/7?"
I'm wondering where this question keeps coming from and why people ask it - of course if I'm launching a public product it should be available 24/7. Is that what the question is?
- Havoc 2y agoYou can rent GPUs by the hour and there are (limited) serverless options too. So this question makes a gigantic difference in cost. >of course if I'm launching a public product it should be available 24/7. Generally yes, but not a given. In some context like data processing you can accumulate tasks and run them in a batch. e.g. OpenAI just launched batches...50% discount but you don't get instant results, you get them somewhere in next 24h
- _akhe 2y agoAhh got it, so not for a real-time consumer use cases then. Typically when I think of a user using an AI product they're hitting the LLM a lot and expecting results on their screen right then, but I guess there are a lot of back office and data processing use cases.