3 ms·
I'm kind of wondering why they need so many different servers to fetch the file from the remote host. It would be smart to at implement rate-limiting, and also
by flexd 12y ago
I'm kind of wondering why they need so many different servers to fetch the file from the remote host.
It would be smart to at implement rate-limiting, and also delegate to a specific server close to the host to fetch the image, and then sync the image/file across their own networks to whatever server needs it.
It is just a huge waste of bandwidth that 100+ servers need to fetch the file, instead of Facebook itself absorbing the cost.
- joshstrange 12y agoWell I would assume that when you add a link to a note the link gets thrown into a queue and a cluster of servers pops items off that queue to fetch and store the result. Also remember FB sees each link as a different link so it can't fetch it once and share it.
- flexd 12y agoI remember reading that FB saw each link as a different link, but I somehow managed to forget that while writing the comment. Oops.