4 ms·

This is awesome. I've been looking for a way to scrape Who's Hiring for my site https://200kjobs.com https://200kjobs.com, thanks for sharing.

nico 3y ago
Thank you for posting your site! Will definitely explore it. Great and simple concept Might try scraping it too ;) Btw, random observation that surprised me when scraping Ask HN, most jobs (100+) are posted the first day of the month, but there are about 15-25 additional jobs posted everyday. This means it’s worth it as a user to get those extra daily listings, but it’s a pain to search through them
- RyanShook 3y ago
  I came across this site which scrapes and shares job postings. The challenge is finding salary ranges: https://hnhiring.com/ https://hnhiring.com/ Feel free to scrape 200kjobs: https://200kjobs.com/feed https://200kjobs.com/feed
  - nico 3y ago
    Thank you! Will definitely go through the feed and try to add it to Command Jobs :) As an aggregator it’s true that finding salary ranges is quite the challenge As an applicant, I’ve settled for just only applying to the positions that have a range If Im really curious about a company without ranges in their listings, GPT/Google sometimes give decent estimates But also, after seeing 100+ listings, I’ve noticed that for the positions I’m looking for, there’s a pretty standard range, which doesn’t vary too much, unless it’s a FAANG or super hot company In any case, using Command Jobs I only get 5-20 job matches, which are also pretty easy to check manually, and it’s not too annoying, given that usually the matches are very interesting and also it’s not 100s of jobs to r
kpandit 3y ago
Your site looks really nice and addresses a real problem. Are you targeting US only remote roles? If not then including any domicile or timezone restrictions in job snippets may be helpful. Also thanks for providing the feed.
- RyanShook 3y ago
  That’s helpful feedback, thank you!
jordinl 3y ago
I'm the author of hnhiring.com, I see you mentioned in another comment. You don't need to scrape Hacker News. You can query Algolia instead: First search for the "Who is hiring post?": https://hn.algolia.com/api/v1/search_by_date?query=hiring&restrictSearchableAttributes=title&tags=story%2Cauthor_whoishiring https://hn.algolia.com/api/v1/search_by_date?query=hiring&re... Note the ID of the first (latest) post and then get the comments: https://hn.algolia.com/api/v1/items/39562986 https://hn.algolia.com/api/v1/items/39562986
- nico 3y ago
  Excellent tip, thank you! hnhiring.com looks super cool, I'm curious if you have any stats or infographics about the data have you played with the data and LLMs to try to get some insights?
  - jordinl 3y ago
    There is a trends page at https://hnhiring.com/trends https://hnhiring.com/trends I only use regexes to extract info. Haven't tried LLMs but that could be useful

nico 3y ago

Thank you for posting your site! Will definitely explore it. Great and simple concept Might try scraping it too ;) Btw, random observation that surprised me when scraping Ask HN, most jobs (100+) are posted the first day of the month, but there are about 15-25 additional jobs posted everyday. This means it’s worth it as a user to get those extra daily listings, but it’s a pain to search through them

RyanShook 3y ago
I came across this site which scrapes and shares job postings. The challenge is finding salary ranges: https://hnhiring.com/ https://hnhiring.com/ Feel free to scrape 200kjobs: https://200kjobs.com/feed https://200kjobs.com/feed
- nico 3y ago
  Thank you! Will definitely go through the feed and try to add it to Command Jobs :) As an aggregator it’s true that finding salary ranges is quite the challenge As an applicant, I’ve settled for just only applying to the positions that have a range If Im really curious about a company without ranges in their listings, GPT/Google sometimes give decent estimates But also, after seeing 100+ listings, I’ve noticed that for the positions I’m looking for, there’s a pretty standard range, which doesn’t vary too much, unless it’s a FAANG or super hot company In any case, using Command Jobs I only get 5-20 job matches, which are also pretty easy to check manually, and it’s not too annoying, given that usually the matches are very interesting and also it’s not 100s of jobs to r

kpandit 3y ago

Your site looks really nice and addresses a real problem. Are you targeting US only remote roles? If not then including any domicile or timezone restrictions in job snippets may be helpful. Also thanks for providing the feed.

RyanShook 3y ago
That’s helpful feedback, thank you!

jordinl 3y ago

I'm the author of hnhiring.com, I see you mentioned in another comment. You don't need to scrape Hacker News. You can query Algolia instead: First search for the "Who is hiring post?": https://hn.algolia.com/api/v1/search_by_date?query=hiring&restrictSearchableAttributes=title&tags=story%2Cauthor_whoishiring https://hn.algolia.com/api/v1/search_by_date?query=hiring&re... Note the ID of the first (latest) post and then get the comments: https://hn.algolia.com/api/v1/items/39562986 https://hn.algolia.com/api/v1/items/39562986

nico 3y ago
Excellent tip, thank you! hnhiring.com looks super cool, I'm curious if you have any stats or infographics about the data have you played with the data and LLMs to try to get some insights?
- jordinl 3y ago
  There is a trends page at https://hnhiring.com/trends https://hnhiring.com/trends I only use regexes to extract info. Haven't tried LLMs but that could be useful