3 ms·
The Accept-Encoding header is used to specify the acceptable transfer encodings. Certainly all browsers set it, and most "advanced" frameworks will at least han
by mnarayan01 9y ago
The Accept-Encoding header is used to specify the acceptable transfer encodings. Certainly all browsers set it, and most "advanced" frameworks will at least handle the common values of Transfer-Encoding regardless; a "malicious" crawler will almost certainly have to, as plenty of sites use Accept-Encoding along with User-Agent to block undesirable bots.
- colanderman 9y agoNo, Accept-Encoding pairs with Content-Encoding, not Transfer-Encoding (which is controlled by TE as GP indicated). [1] [2] [1] https://tools.ietf.org/html/rfc7231#section-5.3.4 https://tools.ietf.org/html/rfc7231#section-5.3.4 [2] https://tools.ietf.org/html/rfc7230#section-4.3 https://tools.ietf.org/html/rfc7230#section-4.3
- mnarayan01 9y agoBah I can't read...you two are correct.