4 ms·
Not working for me atm. Maybe use Cloudflare to cache, quick and easy fix while the post is still hot. edit: Working now, great job (pi). Would be nice to see
by CommanderData 8y ago
Not working for me atm. Maybe use Cloudflare to cache, quick and easy fix while the post is still hot.
edit: Working now, great job (pi). Would be nice to see some type of filters.
- lukehero 8y agoThank you for the suggestion! I will work on filters for the site. Any particular filters you'd like to see?
- CommanderData 8y agoSalary, technologies if possible, and job age are all useful. How do you get job data? Is it a mix between apis and direct website scraping?
- lukehero 8y ago>> Is it a mix between apis and direct website scraping? That's right. I am trying to normalise the data from all the sources so I can generate some useful filters.
- CommanderData 8y agoThanks this is fascinating. Do alot of companies (such as indeed) provide APIs for this? I would have thought it goes against their business models. Also is there any legal concerns for website scaping here?
- lukehero 8y agoIndeed do have an API, which I have applied for, but they didn't get back to me yet. Still waiting for a few big job sites to get back to me on using their APIs. Hoping eventually I can get them all! I've made sure not to crawl any sites that do not allow it, such as LinkedIn for example prohibit it, so I left them alone ;)
- CommanderData 8y agoThank you for getting back. I wanted to build a service to gather and analyse all types of job information and see trends. I would ultimately sell the data, however I don't think it would be possible reading some API T&C's. Just a flaunting idea.
- dagoat 8y agoSalary, location, job type/area