4 ms·
Latency.
by mschuster91 3mo ago
Latency.
- rapidaneurism 3mo agoDoes it matter for training?
- bell-cot 3mo agoI'd assume that site selection managers understand how recommending "only useful for training" locations might impact their careers.
- api 3mo agoDoesn’t matter for training or most AI use cases. We are talking tens of ms latency here. I’m gonna guess availability of employees may matter more.
- inigyou 3mo agoOnce built, the DC has like, ten employees. Nine security guards and a part-time on-site technician.
- giantg2 3mo agoNot all loads require low latency to end users.
- _trampeltier 3mo agoLatency for interaction with AI? For something the user use browsers and electron apps. A ping goes around the whole world before your pressed key is visible on the screen.
- mschuster91 3mo ago> Latency for interaction with AI? It's not just AI. Video streaming or game streaming both depend on close proximity to the end user, alone because the data volume would completely overwhelm backhaul links... that's why Youtube, Netflix and a lot of CDNs all have colo facilities close to major population centers and their regionally dominant ISPs. It can be significantly cheaper to pay colo fees at an ISP' s data center than to pay interconnection fees for bulk transfers.
- 9dev 3mo ago> Video streaming or game streaming both depend on close proximity to the end user That's a straw man for this discussion. Yes, there will be a need to place some DCs close to users, but most of them could be located closer to energy production, attached to a backbone network, and the vast majority of customers would not suffer any degradation of service from it.
- high_na_euv 3mo agoDafuck? No way lol Playing from eu on us servers is not playable >A ping goes around the whole world before your pressed key is visible on the screen.
- deleted 3mo ago[deleted]
- thinkindie 3mo agoI don't think that gaming is the focus of the DC discussed in this article. I don't think gaming will ever require a massive buildup as AI nowadays.
- tracker1 3mo agoAre they more playable if the server is in the nearest coast compared to the middle of the US? If you're in the US, for something like AI inference, then RTT within the continental US is probably reasonable. Similar is likely true through most of Europe.
- dumah 3mo agoIncreasing latency can also reduce TCP throughput ceiling, increase in-flight concurrency, and increase server memory consumption.
- deleted 3mo ago[deleted]
- tomxor 3mo ago> A ping goes around the whole world before your pressed key is visible on the screen. I don't disagree with your sentiment, but as someone who manages infrastructure which is literally on the opposite side of the planet (from me) RTT is long enough to be objectively horrible for anything interactive like typing over SSH. At least 250ms capital to capital for Europe to Oceania + last mile latency makes 300ms a more realistic minimum + actual processing time + client side rendering and it really starts to feel like a half second from the full human perspective... Under ideal conditions.
- thelastgallon 3mo agoWhats the relevance of fibre optic latency to electric lines?
- bigfishrunning 3mo agoEither the data center is in the wind belt and you run fiber to the people, or the data center is near the people and you run power to the source. Either way you have to do some kind of cable run, and that means land.
- exe34 3mo agofiber is a lot easier to run under houses than hvdc.
- thelastgallon 3mo agoThere was a massive dark fiber buildout in 2000. The hyperscalers already have long haul fiber optic infrastructure everywhere in US.