11 ms·
> Sure you can, if you can self host 8x A100 cards ($200k+), plus the cost of electricity and heat dissipation. Well, you don’t need it on all the time, so if
by dragonwriter 4y ago
> Sure you can, if you can self host 8x A100 cards ($200k+), plus the cost of electricity and heat dissipation.
Well, you don’t need it on all the time, so if you don’t mind having the compute & model in the cloud (and since “data pods” seem to be a concept that TBL is pitching that would likely be implemented in the cloud, just with sharing being granular and white-listed, you probably don’t if you buy into that), you could just spin up an EC2 p4d.24xlarge instance for a little under $0.01/s when needed.