3 ms·
"Turns out that Reddit [API] has a limit. It'll only show you 100 posts at a time." 100 sounds like a typical "max-requests" pipelining limit. He does not men
by textmode 8y ago
"Turns out that Reddit [API] has a limit. It'll only show you 100 posts at a time."
100 sounds like a typical "max-requests" pipelining limit.
He does not mention CURLMOPT_PIPELINING.
Does this mean he makes 100 TCP connections in order to make 100 HTTP requests?
- meritt 8y agoThe 100 has nothing to do with HTTP pipelining, it's just a standard REST style "&limit=100" hard limit
- textmode 8y agoYou might be right. With the "&limit" parameter he can change how many items he receives per HTTP request. This has nothing to do with a limit on how many HTTP requests he can make per TCP connection (pipelining). Maybe that is the "100" he is complaining about, i.e., 100 items per HTTP request. However you failed to answer my question: Is he making 100 TCP connections to make 100 HTTP requests? Does the Reddit server set a limit on how many HTTP requests he can make per connection? (100 is a common limit for web servers) Sometimes the server admins may set a limit of 1 HTTP request per TCP connection. This prevents users from pipelining outside the browser, e.g., with libcurl or some other method.
- meritt 8y agoI didn't feel the need to answer your question because it was abundantly clear in the code that it's not using pipelining. You posted the exact curl option that he's not using.
- textmode 8y agoI apologise if I confused you. I was simply wondering why he is not using pipelining, which IME can be ideal for the sort of text retrieval he is performing.