3 ms·

Thanks for putting this together! Amazon is far and away the priciest option here, but I wonder if a big part of that is the convenience tax for the Bedrock ser

by causal 3y ago

Thanks for putting this together! Amazon is far and away the priciest option here, but I wonder if a big part of that is the convenience tax for the Bedrock service. Would be interesting to compare that to the price of just renting AWS GPUs on EC2.

Gcam 3y ago
Yes! An interesting insight is that the smaller, emerging hosts also offer strong relative performance (throughput - tokens per second)