8 ms·

For some reason, text highlight didn't work, so here's the text-highlighted link: https://cloud.google.com/blog/products/compute/whats-new-with-ai-hypercomputer

For some reason, text highlight didn't work, so here's the text-highlighted link: https://cloud.google.com/blog/products/compute/whats-new-with-ai-hypercomputer?e=48754805#:~:text=thinly%2Dprovisioned%20pool.-,Rapid%20Storage,-%3A%20A%20new https://cloud.google.com/blog/products/compute/whats-new-wit...

xk3 2y ago
The gods strip off interesting bits of URLs when you submit it
- dang 2y ago
  if you saw that code you wouldn't deify it
  - lazide 2y ago
    Moloch was also a god!
  - SweetLlamaMyth 2y ago
    It took me 4-5 attempts to not read: > If you saw that code, you wouldn't _defy_ it
deleted 2y ago
[deleted]
dang 2y ago
That link doesn't work for me, so here's the relevant bit: Rapid Storage: A new Cloud Storage zonal bucket that enables you to colocate your primary storage with your TPUs or GPUs for optimal utilization. It provides up to 20x faster random-read data loading than a Cloud Storage regional bucket. (Normally we wouldn't allow a post like this which cherry-picks one bit of a larger article, but judging by the community response it's clear that you've put your finger on something important, so thanks! We're always game to suspend the rules when doing so is interesting.)
- alobrah 2y ago
  Apologies! First time making a post on hacker news, and I thought this was really exciting news. FWIW, I talked to the presenter after this was revealed during the NEXT conference today, and he seems to have implied that zonal storage is quite close to what Google seems to have with Colossus.
  - dang 2y ago
    Oh no, don't apologize - this was a case where you did exactly the right thing and I'm glad you posted! (I was just adding some explanation for more seasoned users who might wonder why we were treating this a bit differently.) Also, welcome to posting on HN and we hope you'll continue!
- noahl 2y ago
  There's now another blog post about Rapid storage specifically: https://cloud.google.com/blog/products/storage-data-transfer/how-the-colossus-stateful-protocol-benefits-rapid-storage https://cloud.google.com/blog/products/storage-data-transfer... . (That wasn't up yet when the original post was made.)
  - dang 2y ago
    Ah excellent—that's what we were waiting for. I've changed the URL to that from https://cloud.google.com/blog/products/compute/whats-new-with-ai-hypercomputer https://cloud.google.com/blog/products/compute/whats-new-wit... above. Thanks!

xk3 2y ago

The gods strip off interesting bits of URLs when you submit it

dang 2y ago
if you saw that code you wouldn't deify it
- lazide 2y ago
  Moloch was also a god!
- SweetLlamaMyth 2y ago
  It took me 4-5 attempts to not read: > If you saw that code, you wouldn't _defy_ it

deleted 2y ago

[deleted]

dang 2y ago

That link doesn't work for me, so here's the relevant bit: Rapid Storage: A new Cloud Storage zonal bucket that enables you to colocate your primary storage with your TPUs or GPUs for optimal utilization. It provides up to 20x faster random-read data loading than a Cloud Storage regional bucket. (Normally we wouldn't allow a post like this which cherry-picks one bit of a larger article, but judging by the community response it's clear that you've put your finger on something important, so thanks! We're always game to suspend the rules when doing so is interesting.)

alobrah 2y ago
Apologies! First time making a post on hacker news, and I thought this was really exciting news. FWIW, I talked to the presenter after this was revealed during the NEXT conference today, and he seems to have implied that zonal storage is quite close to what Google seems to have with Colossus.
- dang 2y ago
  Oh no, don't apologize - this was a case where you did exactly the right thing and I'm glad you posted! (I was just adding some explanation for more seasoned users who might wonder why we were treating this a bit differently.) Also, welcome to posting on HN and we hope you'll continue!
noahl 2y ago
There's now another blog post about Rapid storage specifically: https://cloud.google.com/blog/products/storage-data-transfer/how-the-colossus-stateful-protocol-benefits-rapid-storage https://cloud.google.com/blog/products/storage-data-transfer... . (That wasn't up yet when the original post was made.)
- dang 2y ago
  Ah excellent—that's what we were waiting for. I've changed the URL to that from https://cloud.google.com/blog/products/compute/whats-new-with-ai-hypercomputer https://cloud.google.com/blog/products/compute/whats-new-wit... above. Thanks!