5 ms·
Thank you for the suggestion! I will work on filters for the site. Any particular filters you'd like to see?
by lukehero 8y ago
Thank you for the suggestion! I will work on filters for the site. Any particular filters you'd like to see?
- CommanderData 8y agoSalary, technologies if possible, and job age are all useful. How do you get job data? Is it a mix between apis and direct website scraping?
- lukehero 8y ago>> Is it a mix between apis and direct website scraping? That's right. I am trying to normalise the data from all the sources so I can generate some useful filters.
- CommanderData 8y agoThanks this is fascinating. Do alot of companies (such as indeed) provide APIs for this? I would have thought it goes against their business models. Also is there any legal concerns for website scaping here?
- lukehero 8y agoIndeed do have an API, which I have applied for, but they didn't get back to me yet. Still waiting for a few big job sites to get back to me on using their APIs. Hoping eventually I can get them all! I've made sure not to crawl any sites that do not allow it, such as LinkedIn for example prohibit it, so I left them alone ;)
- CommanderData 8y agoThank you for getting back. I wanted to build a service to gather and analyse all types of job information and see trends. I would ultimately sell the data, however I don't think it would be possible reading some API T&C's. Just a flaunting idea.
- dagoat 8y agoSalary, location, job type/area