4 ms·

That's like $80k worth of data transfer. Also, how can you afford to store all of that unless you have gsuite? Edit: I was mixed up. I was thinking of what it

That's like $80k worth of data transfer. Also, how can you afford to store all of that unless you have gsuite? Edit: I was mixed up. I was thinking of what it would cost SoundCloud to transfer all that music. I guess storing it would be much cheaper...

deleted 9y ago
[deleted]
distantsounds 9y ago
It's all in gsuite, I believe. For how long, I don't know. I can't imagine Google not taking notice.
- userbinator 9y ago
  ...which means the next step is to get it out of gsuite and into more permanent archival storage.
kuschku 9y ago
$80k? Even at Hetzner, which is one of the more expensive hosters w.r.t. transfer, this costs less than $1100. If you directly run traffic agreements with ISPs, and peer directly, you can get below half of that. Where are you getting those moon prices? AWS? GCP? Never use their prices to get a fair estimate, AWS and GCP's prices are orders of magnitudes off from a fair price. Unless you're in Silicon Valley, running systems yourself at a traditional datacenter will always end up cheaper. (The issue behind that being that Amazon and Google have to pay far higher wages than you, and you can cut out a middleman)
- fgandiya 9y ago
  I estimated using GCPs egress pricing since I was thinking if how much it would cost SoundCloud. Still, it's quite impressive to be able to manage that much data.
  - kuschku 9y ago
    I'd be very surprised if SoundCloud paid anything near the standard GCP pricing. It's much more likely that at their scale they pay the rates I mentioned. That said, if they pay the rates you mentioned, then it's no wonder the company fell apart.
chatmasta 9y ago
You can buy a dedicated server ($50-200/mo) hooked up to a 1Gbps line ($1-2k/mo). Assuming you fully saturate the link, 900TB will take 83 days to download. Of course you can also rent a bigger line, or more of them. And this doesn't consider storage costs. But it's certainly less than $80k. Edit: I think you could even rent at a datacenter that peers with amazon, hook your server with the files up to a VPC via ipsec, then move files to s3 or glacier via a server in the VPC. Not sure if you could avoid the PUT costs, but you would avoid amazon bandwidth charges with the peering, I think (not 100% sure).
- niklasrde 9y ago
  AWS Direct Connect out of AWS into the connected DC costs per GB according to https://aws.amazon.com/directconnect/pricing/. https://aws.amazon.com/directconnect/pricing/.. and it's quite the pretty penny!
  - chatmasta 9y ago
    Yes, but looks like transfer in is free (other than paying for the pipe). So in the scenario we are discussing, you could get 900tb into AWS fairly cheaply.
- tracker1 9y ago
  And how much do you need to spend on HDDs and how many do you need for 900TB of data? WD 10TB Gold drives on newegg are $414 * 90 = 37260, now you want at least a 25% raid redundancy... $46575... now, you need how many U of space to store all those drives? It's not just something you can throw in a 1U host. Even if you can get 125 drives in servers 12 at a time, you still need at least a 3U * 10, 30U, so that's a pretty expensive hosting proposition, beyond the $50K for drives alone
  - userbinator 9y ago
    This might be an application where the cost of a tape drive + many tape cartridges will be far less than the cost of HDDs. LTO-6 tapes are ~$4/TB and the drive is a few $K. Tapes are also more reliable than HDDs for long-term archival storage.
tbrock 9y ago
Are we calling Google cloud gsuite now?
- fgandiya 9y ago
  I estimated the cost really badly based on the go egress pricing. Also, I was thinking that gsuite would be the cheapest option since it has "unlimited" storage.
- unixhero 9y ago
  No
- _e 9y ago
  G Suite is the new name for Google Apps. I believe the person they are referring to is storing everything in Google Drive.
Veratyr 9y ago
He's been active on Reddit and IRC. He claims to be storing it in GSuite after ripping it with Google Compute Engine. Since incoming traffic is free and outgoing traffic to other Google services is free, bandwidth costs would be minimal (just the size of the requests, not the responses).
- sitkack 9y ago
  Still has to pay for storage? GCS nearline?
  - mcintyre1994 9y ago
    GSuite has unlimited storage (until enough people do things like that I guess).

deleted 9y ago

[deleted]

distantsounds 9y ago

It's all in gsuite, I believe. For how long, I don't know. I can't imagine Google not taking notice.

userbinator 9y ago
...which means the next step is to get it out of gsuite and into more permanent archival storage.

kuschku 9y ago

$80k? Even at Hetzner, which is one of the more expensive hosters w.r.t. transfer, this costs less than $1100. If you directly run traffic agreements with ISPs, and peer directly, you can get below half of that. Where are you getting those moon prices? AWS? GCP? Never use their prices to get a fair estimate, AWS and GCP's prices are orders of magnitudes off from a fair price. Unless you're in Silicon Valley, running systems yourself at a traditional datacenter will always end up cheaper. (The issue behind that being that Amazon and Google have to pay far higher wages than you, and you can cut out a middleman)

fgandiya 9y ago
I estimated using GCPs egress pricing since I was thinking if how much it would cost SoundCloud. Still, it's quite impressive to be able to manage that much data.
- kuschku 9y ago
  I'd be very surprised if SoundCloud paid anything near the standard GCP pricing. It's much more likely that at their scale they pay the rates I mentioned. That said, if they pay the rates you mentioned, then it's no wonder the company fell apart.

chatmasta 9y ago

You can buy a dedicated server ($50-200/mo) hooked up to a 1Gbps line ($1-2k/mo). Assuming you fully saturate the link, 900TB will take 83 days to download. Of course you can also rent a bigger line, or more of them. And this doesn't consider storage costs. But it's certainly less than $80k. Edit: I think you could even rent at a datacenter that peers with amazon, hook your server with the files up to a VPC via ipsec, then move files to s3 or glacier via a server in the VPC. Not sure if you could avoid the PUT costs, but you would avoid amazon bandwidth charges with the peering, I think (not 100% sure).

niklasrde 9y ago
AWS Direct Connect out of AWS into the connected DC costs per GB according to https://aws.amazon.com/directconnect/pricing/. https://aws.amazon.com/directconnect/pricing/.. and it's quite the pretty penny!
- chatmasta 9y ago
  Yes, but looks like transfer in is free (other than paying for the pipe). So in the scenario we are discussing, you could get 900tb into AWS fairly cheaply.
tracker1 9y ago
And how much do you need to spend on HDDs and how many do you need for 900TB of data? WD 10TB Gold drives on newegg are $414 * 90 = 37260, now you want at least a 25% raid redundancy... $46575... now, you need how many U of space to store all those drives? It's not just something you can throw in a 1U host. Even if you can get 125 drives in servers 12 at a time, you still need at least a 3U * 10, 30U, so that's a pretty expensive hosting proposition, beyond the $50K for drives alone
- userbinator 9y ago
  This might be an application where the cost of a tape drive + many tape cartridges will be far less than the cost of HDDs. LTO-6 tapes are ~$4/TB and the drive is a few $K. Tapes are also more reliable than HDDs for long-term archival storage.

tbrock 9y ago

Are we calling Google cloud gsuite now?

fgandiya 9y ago
I estimated the cost really badly based on the go egress pricing. Also, I was thinking that gsuite would be the cheapest option since it has "unlimited" storage.
unixhero 9y ago
No
_e 9y ago
G Suite is the new name for Google Apps. I believe the person they are referring to is storing everything in Google Drive.

Veratyr 9y ago

He's been active on Reddit and IRC. He claims to be storing it in GSuite after ripping it with Google Compute Engine. Since incoming traffic is free and outgoing traffic to other Google services is free, bandwidth costs would be minimal (just the size of the requests, not the responses).

sitkack 9y ago
Still has to pay for storage? GCS nearline?
- mcintyre1994 9y ago
  GSuite has unlimited storage (until enough people do things like that I guess).