11 ms·
Nowadays storage and bandwidth is cheap as long as you're not going through a hyperscaler and it doesn't require compute (ie. "dead" data). I'm working mostly o
by Bayart 2mo ago
Nowadays storage and bandwidth is cheap as long as you're not going through a hyperscaler and it doesn't require compute (ie. "dead" data). I'm working mostly on GCP so I'm not sure what are the rates now, but at least AWS were known for billing insane numbers on egress.
As long as you're smart on caching on the edges and deduplication/overlaying with your content (which structured data types like models, containers and repos typically are fit for) you can get remarkably far for less than you'd think.
The economics of serving models seem to be way more dodgy.