5 ms·
Bedrock is cool, but I found it prohibitively expensive for hobbyists and small companies. On a first glance, it would cost me something like $ 5,000 per month
by haolez 3y ago
Bedrock is cool, but I found it prohibitively expensive for hobbyists and small companies. On a first glance, it would cost me something like $ 5,000 per month for a simple trained model.
- benjaminwootton 3y agoI suspect most of the cost in the OpenSearch vector database? I agree it is high and it is not exactly serverless. You pay by the hour. Bedrock itself is charged based on tokens exchanged. I think Pinecone is a cheaper database for hobby and small business projects, though I haven't looked into it.
- rmbyrro 3y agoNo, if you use a custom model (trained with your data), you'll pay around $20 per hour, minimum. That equates to ~$15,000. You can reduce a lot by committing to a 6-month contract, but it won't get cheaper than about ~$5,000/mo. That's prohibitively expensive for small projects. Fine tuning GPT 3.5 is much cheaper.
- haolez 3y agoTo be fair, Bedrock is more flexible than OpenAI's fine tuning. It's nice to have at least the option to pay big bucks for this. But it's big bucks nonetheless.
- moltar 3y agoDon’t use OpenSearch it’s way overpriced. Use a cheap-o RDS with pgvector. Everything else is charged like any other LLM by token use.
- haolez 3y agoThis has nothing to do with OpenSearch. Using off the shelf models is cheap and pay as you go. Using custom models is what's expensive.