10 ms·
Show HN: Where is “Who is hiring?” hiring?
- majke 12y agoThere is no way to view the data on the HN website. Please add a link to a source, or at least https://news.ycombinator.com/user?id=whoishiring https://news.ycombinator.com/user?id=whoishiring
- manlio 12y agoFixed that.
- cmpb 12y agoThis is pretty excellent.
- artursapek 12y agoThis is awesome. Only suggestion is to add a backlink to the post and/or user who posted it.
- getsat 12y agoYes, this please. Sometimes there are comments or you want to investigate the profile/history of the poster.
- manlio 12y agoAaaand, feature is up ;)
- artursapek 11y agoAmazing. Thanks so much!
- larsberg 12y agoI should mention that I and other hiring managers I've talked with are moving away from posting on the "Who is hiring?" post. It was pretty useful ~6 months ago. But, the amount of spam generated from recruiting and sourcing firms, various startups trying to push their revolutionary new online coding tools, etc. is pretty ridiculous and many of them, especially the SV-area startups, have been quite aggressive (e.g., phone calls and switching to my personal e-mail address after I told them I was not interested). Posting jobs on twitter has been a far more effective sourcing tool than HN "Who is hiring" has become recently, at least in the free space.
- angersock 12y agoThis is why we can't have nice things. How do you go about posting jobs on Twitter? Rather, is there a special tag you use or something?
- pit 12y agoFrom what I've seen, it's more like "Hey, we're hiring an xyz! Know anybody who'd be interested?" with a link to a web page or email address.
- dang 12y agoRuh roh, that sounds bad. What should we do?
- brandnewlow 12y agoShould "Who Is Hiring" posts require a certain age of account or level of HN Karma to post in?
- brlewis 12y agoThe spammers don't post HN replies; they send email or call.
- deleted 12y ago
- jeromegv 12y agoGreat project, however I've noticed some listings are missing. For example, from April, https://news.ycombinator.com/item?id=9303396 https://news.ycombinator.com/item?id=9303396 there was a posting from Questrade. It's missing on this website.
- manlio 12y agoThanks for the feedback! That particular post is missing because the city is written in all caps (TORONTO). I used a bunch of tricks to be able to catch as many cities as possible (say NY and NYC and Manhattan and even NEW YORK all go under "New York City"), but not every city is tested against its "all caps" equivalent atm because I wanted to be able to rebuild the db as fast as possible during development phase. I should probably fix that now.
- _s 11y agoI used to fall for this a lot so now most string comparisons I do something like // string contains string against lower case / no whitespace cityFromList.indexOf(cityFromPost.trim.toLower()) Might help in your case too?
- manlio 11y agoUnfortunately no, 1) you can't trim the whitespace if you're matching cities, 2) matching the cities lowercase opens up too many false positives. At the same time, matching every city with its uppercase equivalent doubles the time requested to build the db but only adds a tiny handful of posts. That's why (for now) I settled with a tradeoff where I catch the uppercase equivalent for the biggest cities only.
- zo1 12y agoA bit of a side note, it seems someone created an "alternate" who is hiring bot or account: https://news.ycombinator.com/user?id=_whoishiring https://news.ycombinator.com/user?id=_whoishiring
- dang 12y agoOnly because the standard "bot" slept in last time.
- mountaineer 12y agoAh ha, that's why. I publish whoishiring technology trends every month[1] and was curious about the change. Fortunately the API allows a list of users, making it an easy thing to handle. [1] http://www.ryan-williams.net/hacker-news-hiring-trends/ http://www.ryan-williams.net/hacker-news-hiring-trends/
- JshWright 12y agoI assume that was just a DST issue. The bot posted it an hour later than usual, and the DST transition (for the US) took place between the March and April posts.
- dang 12y agoAh so that's why. Good catch.
- smoovej 12y agoThis is fantastic. Thank you!!
- deleted 12y ago[deleted]
- WaxProlix 12y agoShow HN: Ask HN: Where is “Ask HN: Who is hiring?” hiring?
- bhayden 12y agoWorth noting April Houston listings have a false positive because an investor was named Drew Houston.
- lordlarm 12y agoJust a small note about "Cambridge, MA" not being the same place as "Cambridge, UK".
- manlio 12y agoYep, plain Cambridge is "Cambridge, MA", the other one is listed as "Cambridge, UK". In the same fashion, "Venice" is actually "Venice, CA". It hurt a bit but it was the right thing to do ;)
- jn 11y agoGreat work. Looks like Dublin, Ohio is getting categorised as Ireland though: http://whereis-whoishiring-hiring.me/country/2015/3/Ireland http://whereis-whoishiring-hiring.me/country/2015/3/Ireland
- mydpy 12y agoBest URL ever.
- 27182818284 12y agoThis is really cool. Thanks for creating this. I'm not looking at the moment, but I'm always super interested by the Who's Hiring threads.
- meritt 12y agoThis is really cool. I'd love to see this by technology composition too.
- dataker 12y agoGreat work! As a sugestion for next feature, I'd recommend a selection for visa sponsorship or not.
- manlio 12y agoI actually thought about it, but it's a total mess to parse :( Think of posts like "We're sorry we can't sponsor H1B at the moment, but we might get you a VISA for our London office". On the other hand, once you're already browsing New York City, good ol' ctrl-f for VISA will probably serve you well enough.
- c4n4rd 12y agoAgreed on the parsing. It would be nice if there was a standard "form" to be posted. Something line. Description: .... Company: keyworks: python, startup, collstuff Visas Sponsered: YES
- pbhjpbhj 11y agoBack when the web looked (to me) like it was going to move to XHTML2 rather than HTML5 data encoding using Microformats looked promising, http://microformats.org/wiki/job-listing http://microformats.org/wiki/job-listing. One doesn't hear "semantic web" much nowadays though.
- dataker 12y agoI was gonna suggest a sentiment analysis of the sentence associated with H1B, but your last phrase summarizes my lack of ingenuity.
- zuck9 12y agoTypo: "[brose by country]"
- chrisbennet 12y agoShould it have been "bros" by country? :-)
- stephengoodwin 12y agoAlthough I'm sure companies won't complain about the additional publicity, are there any concerns of copyright issues with scraping and republishing the text from other HN posts?
- necrodawg 11y agoIf everyone cared that much about copyright I think no one would ever make anything. There's always a way to sue someone over something, especially copyright.
- stephengoodwin 11y agoI asked out of curiosity, not criticism.
- mountaineer 12y agoThis is cool, nice to look at other projects analyzing this data. I publish HN Hiring Trends, http://www.ryan-williams.net/hacker-news-hiring-trends/ http://www.ryan-williams.net/hacker-news-hiring-trends/ , that watches the various technology terms being mentioned in the postings. Once thing I changed to was just including top level comments and no replies/discussion of the posting. Do you handle similarly?
- manlio 12y agoHN Hiring Trends is really sweet, I didn't know about it. I do include only top level comments; and incidentally, digging through HN's HTML code was... uhm... let's say a bit messy.
- mountaineer 12y agoYeah, I can imagine. HTML is really tricky. Why not use the API? With a few requests, you can query for and pull all of the whoishiring threads. Here's how I pull them all down: https://github.com/ryanwi/hiringtrends/blob/master/lib/hiringtrends/program.rb#L48 https://github.com/ryanwi/hiringtrends/blob/master/lib/hirin...
- ryen 12y agoUseful, but falls short for surrounding areas of Los Angeles like Venice (neighborhood of LA) & Santa Monica (adjacent and much a part of LA). I imagine there are issues like this for other cities and regions too.
- manlio 12y agoQuite the opposite, both Venice and Santa Monica had so many posts I decided to treat them as independent cities, e.g. http://whereis-whoishiring-hiring.me/city/2015/4/Santa%20Monica http://whereis-whoishiring-hiring.me/city/2015/4/Santa%20Mon...
- ugh123 12y agoi believe its not its own city. 2 posts for venice should be part of los angeles. you can still have venice its own section if u want, but excluding it from los angeles doesn't make sense. what u have is too simplistic.
- CalRobert 12y agoI realize that you may be using a limited input device, but surely you can afford a few spare grams of pressure for the shift key, or y and o? Anyway, I can see what you mean re: Venice/LA (Venice is not its own city), but as someone who used to work in Santa Monica there was a time when the ONLY places I would consider were SM, Venice, and just maybe El Segundo (the beach bike path did make for an amazing commute). Having WeHo or Northridge jobs mixed in there could be a pain.
- ugh123 11y agohaving the problem of a few more posts to sift through is much better than the problem of missing something that might have been categorized as "Los Angeles" where the job is actually in venice or santa monica <- happens all the time. these things are just a starting point - further investigation on the company's site and actual location are always necessary.
- 12y ago
- cauterized 12y agoAwesome, awesome idea! Any plans to do the same with "Who's looking for work"?
- manlio 12y agoNot really, but if you want to do it all it takes is to replace the URLs to wget (i.e. you want to wget all the "Who's looking for work" pages instead of the "Who is hiring?"). You can easily build your local Sqlite database like that. I wrote some more instructions about it on the README.md on Github.
- cauterized 12y agoAh, cool. I'll check that out. Thank you for open-sourcing this (and for documenting it)!
- zedpm 12y agoNice name and clean interface! I'm glad to see Remote as a location, but due to the free-form writing in the original posts, there are errors. For example, "Haskell dev at Standard Chartered Bank" is listed under Remote, but the post itself says "Remote work isn’t an option". The post for Button similarly doesn't allow remote, but uses "Remote - no" to convey that. I've been planning on building some filtering for the Who is Hiring threads, and I've pretty much determined that some degree of manual review will be needed. In the most recent thread, I found a huge number of posts containing "remote" which don't actually allow remote working. "No remote" is fairly common and easy to filter out, but there are any number of variations that you can't anticipate a priori.
- manlio 12y ago> I've pretty much determined that some degree of manual review will be needed You're spot on with everything. I did a lot of manual review and the site already filters out "NO REMOTE", "REMOTE no", "Remote not" and "No Remote" entries. I did spot the "Remote work isn’t an option" post, but I decided I'm not going to write that kind of completely ad-hoc filtering rules, it's just ugly.
- louthy 12y agoYou could break the text up into sentences [1] and do sentiment analysis [2] on the sentences with 'remote' in. Then flag based on that. [1] https://opennlp.apache.org/documentation/1.5.3/manual/opennlp.html#tools.sentdetect https://opennlp.apache.org/documentation/1.5.3/manual/opennl... [2] http://nlp.stanford.edu/sentiment/ http://nlp.stanford.edu/sentiment/
- strathmeyer 12y ago...apparently all the companies I am being rejected from are being acquired by all the companies too good to speak to me...
- asherdavidson 12y agoCan you add an option to sort by companies that are offering internships as well?
- andrewjkerr 12y agoI would love to see this as well. If I have some time this weekend, I'll look into submitting a PR :)
- manlio 11y agoDone! Better late than never ;)
- yodsanklai 12y agoGeneral question about remote work: as a european, can you work remotely for an american company without an H1B visa?
- awestroke 12y agoYes. You set yourself up as a contractor and handle country specific taxes etc yourself. The book "Remote: Office Not Required"[1] has a lot of additional information, it's a great read. [1]: http://www.amazon.com/Remote-Office-Required-Jason-Fried/dp/0804137501/ref=sr_1_5?ie=UTF8&qid=1428602774&sr=8-5&keywords=remote http://www.amazon.com/Remote-Office-Required-Jason-Fried/dp/...
- bjelkeman-again 12y agoIs it hard to find remote work in Europe at the moment? Just curious, I haven't had to look, but was under the impression there ought to be a reasonable amount available.
- emp_ 11y agoIt might have to do with the USD being close to the EURO lately, so it opens more options.
- venantius 12y agoSorting by language would be a great feature for this as well, particularly for those of us who work in more obscure / esoteric languages.
- 616c 12y ago
- chatmasta 12y agoVery cool idea, fun name, practical interface. I like it. Perhaps add a simple tagging system where users can add tags to hiring posts. That way you don't need to comb through every post and hopefully you crowdsource some helpful taxonomic data.
- deleted 12y ago[deleted]
- sabman83 12y agoNice work. Makes it easier for me to keep an eye on for jobs in Portland.
- poslathian 12y agocool! you should lump cambridge MA in with boston
- untilHellbanned 12y agoBoston is gaining and should probably be gaining more if lumped together with Cambridge. Less sure about lumping San Francisco and Palo Alto. Thoughts?
- ScottBurson 12y agoI would suggest three buckets: San Francisco, including San Bruno, Millbrae, and Burlingame; Mid-Peninsula, covering San Mateo, Foster City, Belmont, San Carlos, Redwood City, Menlo Park, and Palo Alto; and South Bay, covering Mountain View, Sunnyvale, Santa Clara, San Jose, Cupertino, Campbell, Los Gatos, and Milpitas (and maybe Fremont?).
- xb 12y agoVery cool, and interesting to see the results. I immediately looked for a 'trends' feature to see how cities rank change over time, or maybe this could be plotted?
- Shadow6363 12y agoI'm surprised nobody else has requested this, but any chance for a state category? If you really want to impress me, perhaps a warm and cold climate section or maybe have to shovel snow vs. unlikely to shovel snow. :P Gotta set my priorities straight…
- loblollyboy 12y agoalso alphabetize the cities when there is a tie
- manlio 12y agoLove the alphabetize idea! I just fixed that, thanks for the suggestion :)
- blt 12y agoI was surprised at how few are hiring in Los Angeles. I'm thinking about going to grad school there. Can anyone in LA comment on the state of your tech economy?
- theviajerock 12y agoGreat!
- jlhonora 11y agoThe only way to deal with the unstructured nature of the "Who is hiring" posts is to have some sort of schema that can be processed. I also wanted to do something similar (imagine it with dc.js, for example!), but the data is too diverse. A sample entry could be: company: 'Some Company', jobs: [ { dev_type: 'Web/Mobile/Data', dev_sub_type: 'Frontend/Backend/DevOps/Android/iOS', visa: 'Required/Not required/Transfer only/Sponsored', remote: 'Yes/No/Maybe' locations: [ 'SF', 'London', ... ] }, ... ] All posts could have a METADATA: compressed_json entry that can be processed by the site and displayed/filtered accordingly. Perhaps it could be built manually at the beginning until it catches up.
- nstart 11y agoLove this. I was able to get more useful information about remote working than I was able to when reading the original who is hiring April post. This is probably a good time to suggest changing the format of the who is hiring posts. Would be great if the use of a standard form template is encouraged. That would make an effort to parse the data much easier, and would make the reading of the original post easier, and would probably make it easier for companies to create their posts too. Win for all?
- necrodawg 11y agoReally nicely done. I did something similar as a blog post a good while ago and it was quite popular. The results haven't changed much it seems. One comment I got was that I had just mapped where HN users are in the world.
- ubercow 11y agoAs someone who lives in Washington State, not Washington DC. It always frustrates me trying to sift through the DCs looking for something.
- yitchelle 11y agoMaybe an error but the entry for https://news.ycombinator.com/item?id=9305360 https://news.ycombinator.com/item?id=9305360 is getting confused with Melbourne, Australia. I think is should be under Melbourne, Florida. I am from Melbourne which made me looked at the Australian entries.
- ryan-allen 11y agoThis is great! Thanks for making it :)
- NxSandro 11y agoAwesome work, bookmarking this !
- pknerd 11y agocan you please also provide filter of Technology?