3 ms·

This is awesome! But it's missing at least one company from 2024-08. Maybe a parsing error? Or does it exclude hiring freelance/contract posts?

by welder 2y ago

nemanja_codes 2y ago
Thank you very much, I am glad you like it. I don't understand what is missing in 2024-08? You can link month by slug, I see nothing unusual here: https://hackernews-new-jobs.arm1.nemanjamitic.com/2024-08 https://hackernews-new-jobs.arm1.nemanjamitic.com/2024-08 But as a side note, yes, this is not meant as an exact analytic tool, rather just a best effort website that gives some interesting insights. To clarify, only the "Who's hiring" thread is parsed, you can see it clearly in this constants file: https://github.com/nemanjam/hn-new-jobs/blob/main/constants/algolia.ts https://github.com/nemanjam/hn-new-jobs/blob/main/constants/... Also, in there you can see how simple the parsing regex is, it just looks for "|" separator in the comment title. Another thing I noticed, some companies used different letter casing for their name in some comments, and the company name is part of the primary key, so same company is perceived as different, I should probably handle this better. https://github.com/nemanjam/hn-new-jobs/blob/main/modules/database/schema.ts https://github.com/nemanjam/hn-new-jobs/blob/main/modules/da... For example you can search for "ConsenSys" on the Search page: https://hackernews-new-jobs.arm1.nemanjamitic.com/search?company=consens https://hackernews-new-jobs.arm1.nemanjamitic.com/search?com...
- welder 2y ago
  I didn't realize freelancer jobs go to a different HN post `Ask HN: Freelancer? Seeking freelancer?` Makes sense now, because the job I noticed missing was a freelance post.
  - nemanja_codes 2y ago
    You can try searching directly on Algolia, my website uses it as a data source: https://hn.algolia.com/ https://hn.algolia.com/ https://hn.algolia.com/api https://hn.algolia.com/api If it's there my website has it also. But Algolia does pretty good job parsing HackerNews, I am pretty confident 99.9% of comments are included.

This is awesome! But it's missing at least one company from 2024-08. Maybe a parsing error? Or does it exclude hiring freelance/contract posts?

by welder 2y ago

This is awesome! But it's missing at least one company from 2024-08. Maybe a parsing error? Or does it exclude hiring freelance/contract posts?

nemanja_codes 2y ago

Thank you very much, I am glad you like it. I don't understand what is missing in 2024-08? You can link month by slug, I see nothing unusual here: https://hackernews-new-jobs.arm1.nemanjamitic.com/2024-08 https://hackernews-new-jobs.arm1.nemanjamitic.com/2024-08 But as a side note, yes, this is not meant as an exact analytic tool, rather just a best effort website that gives some interesting insights. To clarify, only the "Who's hiring" thread is parsed, you can see it clearly in this constants file: https://github.com/nemanjam/hn-new-jobs/blob/main/constants/algolia.ts https://github.com/nemanjam/hn-new-jobs/blob/main/constants/... Also, in there you can see how simple the parsing regex is, it just looks for "|" separator in the comment title. Another thing I noticed, some companies used different letter casing for their name in some comments, and the company name is part of the primary key, so same company is perceived as different, I should probably handle this better. https://github.com/nemanjam/hn-new-jobs/blob/main/modules/database/schema.ts https://github.com/nemanjam/hn-new-jobs/blob/main/modules/da... For example you can search for "ConsenSys" on the Search page: https://hackernews-new-jobs.arm1.nemanjamitic.com/search?company=consens https://hackernews-new-jobs.arm1.nemanjamitic.com/search?com...

welder 2y ago
I didn't realize freelancer jobs go to a different HN post `Ask HN: Freelancer? Seeking freelancer?` Makes sense now, because the job I noticed missing was a freelance post.
- nemanja_codes 2y ago
  You can try searching directly on Algolia, my website uses it as a data source: https://hn.algolia.com/ https://hn.algolia.com/ https://hn.algolia.com/api https://hn.algolia.com/api If it's there my website has it also. But Algolia does pretty good job parsing HackerNews, I am pretty confident 99.9% of comments are included.