andrethegiant

7 ms·

91.
by andrethegiant 2y ago
> AFAIK OpenAI currently respects robots.txt I wonder to what degree -- for example, do they respect the Crawl-delay directive? For example, HN itself has a 30-second crawl-delay ( https://news.ycombinator.com/robots.txt )
92.
by andrethegiant 2y ago
> there's typically a 5-7 day gap between updating the robots.txt file and crawlers processing it You could try moving your favicon to another dir, or root dir, for the time being, and update your HTML to match. That way it would be
93.
by andrethegiant 2y ago
[Shameless plug] I'm building a platform[1] that abides by robots.txt, crawl-delay directive, 429s, Retry-After response header, etc out of the box. Polite crawling behavior as a default + centralized caching would decongest the networ
94.
by andrethegiant 2y ago
I'm building a platform for developers to build, deploy, and share web crawlers. It's built entirely on Cloudflare and aims to be the cheapest and easiest solution for crawling tens of millions of pages. https://crawlsp
95.
by andrethegiant 2y ago
I think OP was referring to how fast someone built something with Anthropic's new Computer Use product, as it was announced yesterday
96.
by andrethegiant 2y ago
I’m working on a platform[1] (built on Cloudflare!) that lets devs deploy well-behaved crawlers by default, respecting robots.txt, 429s, etc. The hope is that we can introduce a centralized caching layer to alleviate network congestion from
97.
by andrethegiant 2y ago
That sentence stood out to me too, very powerful. Felt it right in the feels.
98.
by andrethegiant 2y ago
Have you tried the Structured Output feature that OpenAI released last week?
99.
by andrethegiant 2y ago
That's my question -- why license as Apache 2
100.
by andrethegiant 2y ago
> What I'd worry about is Amazon/Cloudflare repackaging my model and outcompeting my platform. Why let Amazon/Cloudflare repackage it?
101.
by andrethegiant 2y ago
I still don’t understand the business model of releasing open source gen AI models. If this took 3072 H100s to train, why are they releasing it for free? I understand they charge people when renting from their platform, but why permit peopl
102.
by andrethegiant 2y ago
Why would it take a couple days? Is it not a matter of uploading the model to their registry, or are there more steps involved than that?
103.
by andrethegiant 2y ago
Let's talk after WWDC
104.
by andrethegiant 2y ago
> Sale price: $598,000 (2.4x annual earnings) Also confused here, the math doesn’t seem to be mathing up
105.
by andrethegiant 2y ago
ML < Rocket Science < AGI
106.
by andrethegiant 2y ago
Same here on everything you mentioned
107.
by andrethegiant 2y ago
You can also, you know, just not use Google
108.
by andrethegiant 2y ago
Andrew Callaghan of Channel 5 News
109.
by andrethegiant 2y ago
I would have no issue if you smooshed a 3D rendering of my house
110.
by andrethegiant 2y ago
What’s wrong with smooshing inanimate objects?
111.
by andrethegiant 2y ago
Lynn hype
112.
by andrethegiant 2y ago
How about some color? Or in other words, how much longer until the Vercel-inspired brutalism fad wears off?
113.
by andrethegiant 2y ago
They should rebuild it from the ground up and call it Iris
114.
by andrethegiant 3y ago
This is super cool
115.
by andrethegiant 3y ago
I was initially confused because Glide is the name of a different YC company (from W19: https://www.ycombinator.com/companies/glide ). But now I understand that Glide is the name of your product, but not company
116.
by andrethegiant 3y ago
> Simply put, wearing the Doggo t-shirt is an incredibly awesome experience. Reeks of buyer’s remorse. No one cares about your shirts. Imagine if they used that 200k to buy carbon offsets instead.
117.
by andrethegiant 3y ago
The iPhone launched without an App Store at all, and it did just fine
118.
by andrethegiant 3y ago
what is SLAPP in this context?
119.
by andrethegiant 3y ago
Dashboard widgets! I miss those — yes we still have widgets in macOS, but being able to author in HTML/JS/CSS really leveled the playing field in who could contribute. I made a widget called Gas that fetched local gas prices, and
120.
by andrethegiant 3y ago
Will give this a try. I had given up on bookmarking and now rely on Raycast to search through my browser history, which works pretty well. But I miss the browsability, and screenshots for each page entry. What would be awesome is if I could

More ›