5 ms·
What is "next gen" in this implementation? Chrome support? IMO the hardest things in distributed crawling at scale are a good URL frontier, priorities, rate l
by rouxz 4y ago
What is "next gen" in this implementation? Chrome support?
IMO the hardest things in distributed crawling at scale are a good URL frontier, priorities, rate limiting and things like that, which are quite often overlooked.
- dang 4y agoWe took 'next gen' out of the title since it's borderline clickbaity and tends to be a distraction.
- 1vuio0pswjnm7 4y agoWould be nice if HN could remove clickbait terms like "modern", "next-generation", "blazingly fast", etc. These characterisations only look dated if not silly when we look at them years down the road.
- kulikalov 4y agoHi Could contact me? We may have some interests in common. Check my profile.
- 1vuio0pswjnm7 4y agoWhat are these interests.
- deleted 4y ago[deleted]
- sidpatil 4y agoI wish all technology naming would follow this rule. Fast Ethernet is my favorite example.
- harryvederci 4y agoReminds me of "The New Cook Book"[0] in the kitchen of a family member. That book is older than I am. [0] (translated title)
- yourapostasy 4y agoIn jest: I'd give an allowance to any product that steps right on the boundary of what we currently know as the fundamental limits of physics. Like Shannon entropy for a compression implementation. Or Planck length for processors.
- staplung 4y agoHeheh. (Planck length is 10e-35. Even the strong nuclear force operates on a scale that's like 20 orders or magnitude larger (10e-15). And a hugantuan electron? Forget about it.)
- chimen 4y ago"built with Rust" while you're at it :)
- 1vuio0pswjnm7 4y agoI too had the inclination to include that one, but I hesitate because in theory, IMHO, it would be useful to know the language used for each software announcement on HN. In practice, putting the language used into a title is pure hype. Almost invariably, I still have to manually check source listings to confirm what language is being used. Lord only knows how much time I waste checking only to find the project is written in some language I do not use. Today HN titles may be likely to contain "written in Rust" but not long before they frequently contained "written in Go".