3 ms·
Unfortunately I think Kagi only has old Reddit content now that Reddit only lets Google crawl them: https://news.ycombinator.com/item?id=41057033 https://news.y
by eli 2y ago
Unfortunately I think Kagi only has old Reddit content now that Reddit only lets Google crawl them: https://news.ycombinator.com/item?id=41057033 https://news.ycombinator.com/item?id=41057033
- msmithstubbs 2y agoKagi uses Google as one of its sources for search results so should be able to return the same reddit results as Google.
- eli 2y agoDoesn't seem like it. Can you get it to return a reddit result from the last 6 weeks?
- deleted 2y ago[deleted]
- ezekg 2y agoI'm able to search a post I made a couple weeks ago: https://kagi.com/search?q=%22union_of%22+site%3Areddit.com https://kagi.com/search?q=%22union_of%22+site%3Areddit.com
- msmithstubbs 2y agoTry this: https://kagi.com/search?q=remarkable+pro+site%3Areddit.com https://kagi.com/search?q=remarkable+pro+site%3Areddit.com It includes Reddit results from less than 24 hours ago.
- eli 2y agoAh hmm. Maybe they are doing something special with "site:reddit.com" queries. If I search for that exact Reddit post using the lens it isn't there. https://kagi.com/search?q=ReMarkable+Paper+Pro+hands-on+review%3A+The+tablet+for+writers%2C+now+in+color&l=2 https://kagi.com/search?q=ReMarkable+Paper+Pro+hands-on+revi...
- darby_nine 2y agoCuriously this link seems to show the "Academic" lens. Switching to the "Forums" lens pulls it right up for me.
- atombender 2y agoThe lens ID in the URL doesn't look to be globally unique. It's just l=<number>, and the number seems to be order in the lens list under your account.
- littlecranky67 2y agoWell, there never was any law that required robots.txt to be honored. Big players like Google do, but I am not aware of any consequences if they wouldnt (of course UNTIL it is then regulated).
- kelnos 2y agoI don't think there's anything special; I very often get new-reddit results with no 'site:' qualifier. I can't think of a specific query offhand, but it happens multiple times daily for me.
- aequitas 2y agoFor me it doesn’t show up in your link with the full article title but with this one it’s the 3rd result or so: https://kagi.com/search?q=remarkable+pro+hands+on+review https://kagi.com/search?q=remarkable+pro+hands+on+review
- lotsofpulp 2y agoOld Reddit (and other website) content might actually be more valuable given the higher likelihood of newer posts being spam/AI bot posts.
- DoughnutHole 2y agoThat disregards the fact that facts change over time. If you google “best DSLR camera reddit” it’s much less valuable if the results are 5 years old, even if they’re LLM free - the cameras on the market may very well have changed in that timeframe.
- deleted 2y ago[deleted]
- inquirerGeneral 2y agoWhat? Old reddit isn't using old facts. I skimmed down and if this was about Kagu indexing being out of date then sorry I just realized that
- klez 2y agoNot "Old reddit" as in https://old.reddit.com https://old.reddit.com. "Old Reddit" as in "Older stuff on reddit before they gave access only to Google".
- ulrikrasmussen 2y agoI really think it's crazy how a big site like that can get away with locking out everybody else but the search giant with a monopoly.
- Sakos 2y agoYeah, it seems blatantly anti-competitive to me and I'm surprised we haven't seen the EU say anything about it yet.