5 ms·
OP here. As some people were commenting, Scala and excel I guess have some false positives which reflect the unusual popularity. I did try to limit the search t
by vthallam 8y ago
OP here. As some people were commenting, Scala and excel I guess have some false positives which reflect the unusual popularity. I did try to limit the search to exact word, but think that I overlooked that part. I will try fix the code and update the skills chart soon. Thanks for pointing it out.
Edit: I fixed the false positives using a word boundary on regex "\\bword\\b". The data now seems little sane, will keep looking for any false positives. updated the data and regenerated the chart using new data.
- dabernathy89 8y agoWhile you're at it, you've got `vuejs` and `vue.js` listed separately :)
- bcherny 8y agoSame for “react” and “reactJS”.
- notyourloops 8y agoIt's really cool, but it's not going to be useful until you correct these errors. You might want to provide a note to readers in the meantime.
- vthallam 8y agoThanks. I added a note at the skills section about the false positives. Really should have paid attention, but i guess i was just excited to show it off, first :(. I am on it fixing the regex.
- aerotwelve 8y agoYou might want to consider performing your text analysis using something with a negex implementation; this would distinguish an instance of "remote" from "no remote" or "can't hire remote".
- deleted 8y ago[deleted]
- dvaughan 8y agoI don't know how best to handle "go" as well as "golang" without false positives.
- onlyrealcuzzo 8y agoMaybe it's in Facebook's word2vec?
- jnbiche 8y agoword2vec is a Google project.
- ticmasta 8y agoI'd also expect some tough to catch exceptions for remote, as that's something I always look at and despite the posting guidelines, posters can't stop themselves from adding things like "sorry, no remote available at this time" or "part-time remote might be an option for the right person in some roles". I get that you're trying to be complete, but if it's not a truly remote position, it's not remote. put nothing about remote in the position or at the very most "REMOTE: NO". Working from home 10% of the time but needing to be in a SF office the rest of the time is not a remote position; it's the flexibility I'd expect from most jobs in this industry.
- travisjungroth 8y agoTry searching craigslist for a shared apartment for a couple. "Sorry, no couples!"
- Topgamer7 8y agoSame kind of issue for us Canadians. Search for remote: "remote us only"
- whyonearth 8y agoYou have to get clever when searching CL. Plenty of places that allow cats don't click the "Cats OK" box. Instead of using that search filter, include the terms -"no cats" -"no pets". In your case, -"no couples". My CL searches to filter the fake 1BRs get pretty crazy (-roommate -"room for rent" -jr -junior -studio, etc...) but their search engine handles complex queries well.
- lozenge 8y agoI'm guessing they get a lot of speculative remote applications, so are trying to prevent that.
- wooly_bully 8y agoYou've got some citizens of Null Island in your data! https://en.wikipedia.org/wiki/Null_Island https://en.wikipedia.org/wiki/Null_Island
- hocuspocus 8y agoThere seem to be errors in geo-locations as well. No results for Zurich while it's the biggest hub in Switzerland. A suspiciously high number in Venice, Italy (I think it's safe to assume California here).
- vthallam 8y agoI completely relied on the python package "GeoText" for locations.I see Geneva and Lausanne from Switzerland, i will have to double check if the package missed it or there were not many posts on the hiring thread. Thanks for pointing it out.
- souprock 8y agoHow did GeoText do on mine? https://news.ycombinator.com/item?id=18358038 https://news.ycombinator.com/item?id=18358038
- vthallam 8y ago{'Huntsville': 1, 'Arlington': 1, 'Florida': 1, 'Virginia': 1, 'Greenville': 1, 'Melbourne': 1, 'State College': 1, 'Maryland': 1, 'Austin': 1, 'San Antonio': 1, 'Texas': 2}
- throwaway26497 8y agoThere were definitely posts for both "Zurich" and "Zürich" in almost every thread.
- mygo 8y ago"We do not accept REMOTE applicants" would still be a false positive. And same would go for visa. "We do not sponsor VISA" I really think you're going to have to do some sort of sentiment analysis, either via human or machine.
- segmondy 8y agoEdit 2 is still broken, I find it hard to believe there are less skills than total number of jobs or position posted.
- dmode 8y agoOP, thanks for the analysis. Really appreciate it. Quick question - Does San Francisco include abbreviations like "SF" or "San Fran" ? Does it also include jobs in the Valley towns like Palo Alto and San Mateo ?