4 ms·
Indiscriminate scraping is a dick move. But if you’re going to do it, do it properly. I would have hung it off the Like button with an ungodly ZooKeeper ensemb
by benreesman 2y ago
Indiscriminate scraping is a dick move.
But if you’re going to do it, do it properly. I would have hung it off the Like button with an ungodly ZooKeeper ensemble and trained a GBDT on which parts of which URLs I could just obliterate with Proxygen.
We’d have it all in about 4 days. Don’t ask me how I know.
The second worse thing about the AI megacorps after being evil is being staffed by people who use Cursor.
Edit: on the back of the valued feedback of a valued commenter I’d like to acknowledge that I made a sloppy mistake and have corrected in haste, making no excuses. It would be super great if the largest private institutions in history of the world took the care with give or take everything that I do with trolling on a forum.
- viraptor 2y ago> is being staffed by people who use Cursor. Any specific reason?
- benreesman 2y agoPlenty of smart people use Cursor I shouldn’t have been dismissive. I meant people who don’t work at Cursor.
- deleted 2y ago[deleted]
- trunch 2y agoNot OP but other than what core functionality they can demo to investors, every AI company seems to have extremely lacking: - web design (basic features take years to implement, and when done break the website on mobile) - UI/UX patterns (cookie cutter component library elements forced into every interface without any tailoring to suit how the product is actually used, also makes a Series C venture indistinguishable from something setup in a weekend) - backend design (turns out they've been hemorrhaging money on serverless Vercel function calling instead of using Lambda and spending a minute implementing caching for repeat requests) - developer docs (even when crucial to business model, often seems AI generated, incomplete, incoherent) And this usually comes from hiring much less developers than is needed, and those that are hired are 10x Cursor/GPT developers which trust it to have done a comprehensive job at what seems like a functional interface on the surface, and have little frame of reference or training for what constitutes good design in any of these aspects.
- benreesman 2y agodawg I ChatGPT’d that license, busy building rn.
- raverbashing 2y ago> (turns out they've been hemorrhaging money on serverless Vercel function calling instead of using Lambda and spending a minute implementing caching for repeat requests) Oh but why can't the AI do basic backend programming anymore? /s
- benreesman 2y agoI was the guy trolling, downvote me. Don’t downvote the person who submitted a substantial comment far more valuable than it’s GP.
- vasco 2y ago> But if you’re going to do it, do it proerly Top shelf unintentional irony.
- Rinzler89 2y agoExactly. That line of reasoning just feels like established players kicking the ladder from under them in order to maintain their moat, when competitors start to catch up: "Hey, web scraping and data mining should only be allowed the right way, where the right way = our way." "Free market" to them = the market where they get to write the rulebook.
- earth-adventure 2y agoPretty sure he meant the typo.
- vasco 2y agoExactly.
- t_6_t 2y ago[flagged]
- trunch 2y agoOnly on HN could Lex Fridman's endorsement mean anything when it comes to an IDE
- benreesman 2y agoI remember when people said things like “X is endorsed by John Carmack”. But Engine John is just a guest on the real show. I didn’t hang onto the first fortune I made in this game, which in general is a real nuisance, but it has the silver lining that I’m still working and likely will be when Zuckerberg realizes that he hasn’t graduated a class of legitimate E5s since 2017.
- t_6_t 2y ago[flagged]
- benreesman 2y ago^ it’s considered polite to use an “Edit:” annotation when dramatically changing what someone replied to. Cursor is a great product, done by brilliant people. I very much doubt that they set out to dramatically amplify the byte-denominated output and performance-cycle clout of the exact group of people who want to generate their code but find emacs macros or protobuf or any of the more sophisticated zero-temperature codegen mechanisms too high a complexity bar to clear before blasting metric tonnage of generated slop into our collective lives. The target audience of Cursor is the last group of people you want jizzing on your codebase at scale while simultaneously capturing mindshare proportional to NVIDIA’s market capitalization. It’s somewhere between dorky and cringe when Jensen signs some girl’s breasts like he’s Mick Jagger or something. That vibe in your repository is my job security in ten years.
- sshine 2y ago> people who use Cursor What's Cursor?
- ro_bit 2y agoAI based code editing tool (https://www.cursor.com/ https://www.cursor.com/)