3 ms·
Sure you can, if you can self host 8x A100 cards ($200k+), plus the cost of electricity and heat dissipation.
by gigel82 4y ago
Sure you can, if you can self host 8x A100 cards ($200k+), plus the cost of electricity and heat dissipation.
- EVa5I7bHFq9mnYK 4y agoYou can probably share that monster server with others.
- wizeman 4y agoYou probably don't even need to have the server in your premises. Perhaps the server could be in some datacenter and you, as well as others, could use it remotely via the Internet.
- dragonwriter 4y ago> Sure you can, if you can self host 8x A100 cards ($200k+), plus the cost of electricity and heat dissipation. Well, you don’t need it on all the time, so if you don’t mind having the compute & model in the cloud (and since “data pods” seem to be a concept that TBL is pitching that would likely be implemented in the cloud, just with sharing being granular and white-listed, you probably don’t if you buy into that), you could just spin up an EC2 p4d.24xlarge instance for a little under $0.01/s when needed.