3 ms·
Ah okay, I see what you mean with that one. I think the way I would approach Workday is categorizing the different companies that use Workday into certain bucke
by jnguyen64 5y ago
Ah okay, I see what you mean with that one. I think the way I would approach Workday is categorizing the different companies that use Workday into certain buckets. So the example I gave would be one bucket, and the one you gave would be a different bucket. I would create a script for each of these buckets, instead of trying to use a one-size fits all approach. The approach I'd use for the website you linked would be something like:
Create a request mimicking this curl command:
curl 'https://nxp.wd3.myworkdayjobs.com/wday/cxs/nxp/careers/jobs https://nxp.wd3.myworkdayjobs.com/wday/cxs/nxp/careers/jobs' \
-H 'Connection: keep-alive' \
-H 'sec-ch-ua: " Not A;Brand";v="99", "Chromium";v="96", "Google Chrome";v="96"' \
-H 'Accept: application/json' \
-H 'Content-Type: application/json' \
-H 'Accept-Language: en-US' \
-H 'sec-ch-ua-mobile: ?1' \
-H 'User-Agent: Mozilla/5.0 (Linux; Android 5.0; SM-G900P Build/LRX21T) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.45 Mobile Safari/537.36' \
-H 'sec-ch-ua-platform: "Android"' \
-H 'Origin: https://nxp.wd3.myworkdayjobs.com https://nxp.wd3.myworkdayjobs.com' \
-H 'Sec-Fetch-Site: same-origin' \
-H 'Sec-Fetch-Mode: cors' \
-H 'Sec-Fetch-Dest: empty' \
-H 'Referer: https://nxp.wd3.myworkdayjobs.com/en-US/careers?p=4 https://nxp.wd3.myworkdayjobs.com/en-US/careers?p=4' \
--data-raw '{"limit":20,"offset":80,"searchText":"","appliedFacets":{}}' \
--compressed
Change the offset by +20 (second to last row) each time until you reach the desired number of jobs. May need some changes but that's the general approach!
- cushychicken 5y agoThanks for going down the Workday scraping rabbit hole with me. :) Did you pull this from the browser console's "Copy as cURL" function? I tried this with some success (there's even a utility for translating cURL to Python - imagine that! https://curlconverter.com/ https://curlconverter.com/) but I had some issues after a while, probably because the cookie/session token expired.