4 ms·

Can you walk through how you're managing storage of these photos? I've thought about doing something similar, but VPS like DO have very little HDD space. And Am

Can you walk through how you're managing storage of these photos? I've thought about doing something similar, but VPS like DO have very little HDD space. And Amazon S3 is massively expensive. How are you handling the dollar expense vs storage capacity?

StavrosK 7y ago
I'm sticking them all in a Postgres database with CloudFlare in front as a caching proxy. Hetzner gives me 3 TB of bandwidth per month, so I expect that to last me a long time. If CloudFlare hates my usage and I get enough users to make $50/mo, I'll buy a dedicated Hetzner server which comes with a 3 Gbit connection, which will hopefully mean that bandwidth still isn't a problem (or just pay CloudFlare).
- dylz 7y ago
  What plan are these on? I use them and I don't recall either a VM or any dedicated server match those specs (20T, or 1G unmetered, respectively)
  - StavrosK 7y ago
    The 3 TB is any VPS they have, and the 1 Gb (or 3 Gb? I forget) is any of their dedicated servers.
    - dylz 7y ago
      It's 1G "somewhat-shared" unmetered per dedicated and 20TB on their VMs. I don't believe they've ever offered a 3 TB option. Good choice though, their NVMe is also really nice on the VM line.
      - StavrosK 7y ago
        Ah, yes, you're right, it's 20 TB. I think you can pay them for a dedicated pipe, but I've never looked into it...
        dylz 7y ago
        It's usually cheaper to just get another dedicated server and make sure it's in a different DC zone.
        StavrosK 7y ago
        Ah, true, I'll keep that in mind.
        e12e 7y ago
        AFAIK the dedicated servers (at least the "server grade" ones with ecc ram) are all now "un-metered 1 gbps". If you get/buy 10gbps uplink, there's a quota again 20TB included (which is lifted if you commit to paying 1 euro/pr TB over). They basically increased the included bandwidth to the point where it was hard to hit the limits om 1gpbs uplink (although 1 gbps maxed out 24/7 is theoretically 10 TB/day 300/month). "Traffic usage is unlimited and free of charge. Please note that our unlimited traffic policy does not apply to servers that have the 10G uplink addon. In this special case, we will charge the usage over 20TB with € 1.00/TB. (The basis for calculation is for outgoing traffic only. Incoming and internal traffic is not calculated.) There is no bandwidth limitation."
        StavrosK 7y ago
        Can you post a link? I don't see the uplink addon on their wiki, and I'm a bit confused as to how there's no bandwidth limitation if there's a data cap (I guess they mean speed).
        e12e 7y ago
        It's basically in all the "details" pages via the site menu > dedicated (and contrary to what I said, not limited to "enterprise"/ecc ram servers). See for example: https://www.hetzner.com/dedicated-rootserver/ex42-nvme https://www.hetzner.com/dedicated-rootserver/ex42-nvme Ed: i think the implication is that you can just go ahead and use 300tb/month on a 1 gbps port if you can stand doing that... But that 3 000 TB/month on a 10gbps uplink is not included...
- pbalau 7y ago
  > Hetzner gives me 3 TB of bandwidth per month, so I expect that to last me a long time. Oh summer child... one meme going viral on reddit is going to destroy your hopes for the future...
  - StavrosK 7y ago
    :(
    - Sohcahtoa82 7y ago
      Seriously though. If an image gets to the front page of /r/all, it can easily get a million hits. That half megabyte image will consume half a terabyte of data transfer.
      - StavrosK 7y ago
        I don't know how much bandwidth gets CloudFlare to have a chat with me, but I'll cross that bridge when I get routed over it.

StavrosK 7y ago

I'm sticking them all in a Postgres database with CloudFlare in front as a caching proxy. Hetzner gives me 3 TB of bandwidth per month, so I expect that to last me a long time. If CloudFlare hates my usage and I get enough users to make $50/mo, I'll buy a dedicated Hetzner server which comes with a 3 Gbit connection, which will hopefully mean that bandwidth still isn't a problem (or just pay CloudFlare).

dylz 7y ago
What plan are these on? I use them and I don't recall either a VM or any dedicated server match those specs (20T, or 1G unmetered, respectively)
- StavrosK 7y ago
  The 3 TB is any VPS they have, and the 1 Gb (or 3 Gb? I forget) is any of their dedicated servers.
  - dylz 7y ago
    It's 1G "somewhat-shared" unmetered per dedicated and 20TB on their VMs. I don't believe they've ever offered a 3 TB option. Good choice though, their NVMe is also really nice on the VM line.
    - StavrosK 7y ago
      Ah, yes, you're right, it's 20 TB. I think you can pay them for a dedicated pipe, but I've never looked into it...
      - dylz 7y ago
        It's usually cheaper to just get another dedicated server and make sure it's in a different DC zone.
        StavrosK 7y ago
        Ah, true, I'll keep that in mind.
      - e12e 7y ago
        AFAIK the dedicated servers (at least the "server grade" ones with ecc ram) are all now "un-metered 1 gbps". If you get/buy 10gbps uplink, there's a quota again 20TB included (which is lifted if you commit to paying 1 euro/pr TB over). They basically increased the included bandwidth to the point where it was hard to hit the limits om 1gpbs uplink (although 1 gbps maxed out 24/7 is theoretically 10 TB/day 300/month). "Traffic usage is unlimited and free of charge. Please note that our unlimited traffic policy does not apply to servers that have the 10G uplink addon. In this special case, we will charge the usage over 20TB with € 1.00/TB. (The basis for calculation is for outgoing traffic only. Incoming and internal traffic is not calculated.) There is no bandwidth limitation."
        StavrosK 7y ago
        Can you post a link? I don't see the uplink addon on their wiki, and I'm a bit confused as to how there's no bandwidth limitation if there's a data cap (I guess they mean speed).
        e12e 7y ago
        It's basically in all the "details" pages via the site menu > dedicated (and contrary to what I said, not limited to "enterprise"/ecc ram servers). See for example: https://www.hetzner.com/dedicated-rootserver/ex42-nvme https://www.hetzner.com/dedicated-rootserver/ex42-nvme Ed: i think the implication is that you can just go ahead and use 300tb/month on a 1 gbps port if you can stand doing that... But that 3 000 TB/month on a 10gbps uplink is not included...
pbalau 7y ago
> Hetzner gives me 3 TB of bandwidth per month, so I expect that to last me a long time. Oh summer child... one meme going viral on reddit is going to destroy your hopes for the future...
- StavrosK 7y ago
  :(
  - Sohcahtoa82 7y ago
    Seriously though. If an image gets to the front page of /r/all, it can easily get a million hits. That half megabyte image will consume half a terabyte of data transfer.
    - StavrosK 7y ago
      I don't know how much bandwidth gets CloudFlare to have a chat with me, but I'll cross that bridge when I get routed over it.