3 ms·
> massive amounts of electricity and water ... we need to succeed on all fronts Datacenters' used for training or batch jobs can be placed in places where wate
by teruakohatu 1y ago
> massive amounts of electricity and water ... we need to succeed on all fronts
Datacenters' used for training or batch jobs can be placed in places where water and power are plentiful, ambient temperature are relatively low and government/society are stable.
A datacenter is going to be built at the bottom of New Zealand where all these things are true. There must be plenty of places in the world where this holds true.
At least for training, I think it is possible to have our cake and eat it. For real-time inference, probably not.
- distances 1y ago> A datacenter is going to be built at the bottom of New Zealand where all these things are true. There must be plenty of places in the world where this holds true. There are many datacenters being built in Finland. Water is not running out, and one of the cheapest electricity prices in Europe thanks to plentiful wind power.
- int_19h 1y agoGiven typical inference speeds for SOTA models, I rather suspect that you could also do it for inference without latency being particularly notable. We might need to lay a few more cables to New Zealand though.