4 ms·
I suspect most of the cost in the OpenSearch vector database? I agree it is high and it is not exactly serverless. You pay by the hour. Bedrock itself is cha
by benjaminwootton 3y ago
I suspect most of the cost in the OpenSearch vector database?
I agree it is high and it is not exactly serverless. You pay by the hour.
Bedrock itself is charged based on tokens exchanged.
I think Pinecone is a cheaper database for hobby and small business projects, though I haven't looked into it.
- rmbyrro 3y agoNo, if you use a custom model (trained with your data), you'll pay around $20 per hour, minimum. That equates to ~$15,000. You can reduce a lot by committing to a 6-month contract, but it won't get cheaper than about ~$5,000/mo. That's prohibitively expensive for small projects. Fine tuning GPT 3.5 is much cheaper.
- haolez 3y agoTo be fair, Bedrock is more flexible than OpenAI's fine tuning. It's nice to have at least the option to pay big bucks for this. But it's big bucks nonetheless.