4 ms·

As soon as I saw "17GB file" i thought "that's what torrents are for". Otherwise one mistake and... Well this happens. Or someone maliciously bypasses CF cache

As soon as I saw "17GB file" i thought "that's what torrents are for". Otherwise one mistake and... Well this happens. Or someone maliciously bypasses CF cache e.g. by parameters. Cloud just is not suitable for any kind of volume egress. It's a death trap. Like going on vacation with data roaming enabled.

Aissen 5y ago
Yeah, HIBP is using torrents: > I removed the direct download links from the HIBP website and just left the torrents which had plenty of seeds so it was still easy to get the data. Since then, Cloudflare upped that 15GB limit and I've restored the links for folks that aren't in a position to pull down a torrent. Crisis over.
- knorker 5y ago
  I know, I read the article. But I feel like Dr Strangelove here. Of course, the whole point of a torrent on a cloud service is lost if you also provide a raw download link. Also providing a download link is tempting, but can easily cost (for a 17GB file and growing) up to US $3 per click. Even off of their premium global network it's over $2 per click. The cheapest in Microsofts entire egress table would be $0.68 per click. (but that only kicks in after you've spent way more than $9400 in cheaper tiers in a given month) Egress kills you, in cloud. "Oh, cloudflare probably caches most of this" is not something I'd recommend.
- dx034 5y ago
  And then Cloudflare will not cache it at some locations for random reasons and the cloud bill is back. Anyone with technical knowledge should have no problem routing static files via machines at OVH/Hetzner and the like, no reason to enter such risks for maybe an hour of setup time saved.
dx034 5y ago
Or Hetzner server auction to get a cheap 20/30€ machine with unlimited traffic at 1Gbps. Setup time is max 1h even if you do it manually, with cloudflare Tunnel it's also really easy to lock down everything with a firewall and have minimal exposure to threats.
- InsomniacL 5y ago
  > Setup time is max 1h even if you do it manually - Patching - Remediation, Monitoring, day0 response - Security Information and Event Management - exports, alerts, OS configuration - OS/Application Hardening - Encryption, Password/keys rotation, CIS/other baselines, Drift Management - Backup - Encryption, (don't forget your passwords/keys are changing), retention, data protection compliance, monitoring, alerting, test days - High Availability - replication, synchronisation, monitoring, alerts, test days This is just the tip of the ice berg, if you operate in an environment where Insurance, Reputation, Regulatory Compliance, etc.. are important, then it's easy to see why PAAS solutions are desirable.

Aissen 5y ago

Yeah, HIBP is using torrents: > I removed the direct download links from the HIBP website and just left the torrents which had plenty of seeds so it was still easy to get the data. Since then, Cloudflare upped that 15GB limit and I've restored the links for folks that aren't in a position to pull down a torrent. Crisis over.

knorker 5y ago
I know, I read the article. But I feel like Dr Strangelove here. Of course, the whole point of a torrent on a cloud service is lost if you also provide a raw download link. Also providing a download link is tempting, but can easily cost (for a 17GB file and growing) up to US $3 per click. Even off of their premium global network it's over $2 per click. The cheapest in Microsofts entire egress table would be $0.68 per click. (but that only kicks in after you've spent way more than $9400 in cheaper tiers in a given month) Egress kills you, in cloud. "Oh, cloudflare probably caches most of this" is not something I'd recommend.
dx034 5y ago
And then Cloudflare will not cache it at some locations for random reasons and the cloud bill is back. Anyone with technical knowledge should have no problem routing static files via machines at OVH/Hetzner and the like, no reason to enter such risks for maybe an hour of setup time saved.

dx034 5y ago

Or Hetzner server auction to get a cheap 20/30€ machine with unlimited traffic at 1Gbps. Setup time is max 1h even if you do it manually, with cloudflare Tunnel it's also really easy to lock down everything with a firewall and have minimal exposure to threats.

InsomniacL 5y ago
> Setup time is max 1h even if you do it manually - Patching - Remediation, Monitoring, day0 response - Security Information and Event Management - exports, alerts, OS configuration - OS/Application Hardening - Encryption, Password/keys rotation, CIS/other baselines, Drift Management - Backup - Encryption, (don't forget your passwords/keys are changing), retention, data protection compliance, monitoring, alerting, test days - High Availability - replication, synchronisation, monitoring, alerts, test days This is just the tip of the ice berg, if you operate in an environment where Insurance, Reputation, Regulatory Compliance, etc.. are important, then it's easy to see why PAAS solutions are desirable.