3 ms·
Here's a question I don't know the answer to right off, but we're going to discover together in real time: Which is cheaper, one million queries to fetch the va
by 827a 1y ago
Here's a question I don't know the answer to right off, but we're going to discover together in real time: Which is cheaper, one million queries to fetch the value of a secret from AWS Secrets Manager, or one million tokens from a modern LLM?
Storing a secret in secrets manager: $0.40
$0.05/10,000 API calls * 1,000,000 calls = $5
Total cost: $5.40.
Gemini 2.5 Flash: $0.15/million tokens.
Well, there you have it. Storing a secret value in AWS Secrets Manager is ~36 times more expensive per API call than querying an LLM!