3 ms·
faustian bargain: you trade scrape ability for your website for one click buy of your product.
by abalaji 2y ago
faustian bargain: you trade scrape ability for your website for one click buy of your product.
- gcanyon 2y agoIt's hardly faustian if your goal is to sell your product. If you have some weird hybrid sales/content-based ad revenue setup, then yeah, maybe it's faustian.
- carlosjobim 2y agoIf you sell a product you want everybody to scrape as much as possible from your website.
- simonw 2y agoThe document suggests unblocking OAI-SearchBot in robots.txt, and then clarifies: > OAI-SearchBot is for search. OAI-SearchBot is used to link to and surface websites in search results in ChatGPT's search features. It is not used to crawl content to train OpenAI’s generative AI foundation models. Learn more (opens in a new window).