23 ms·

Claude can now search the web

1233 points by meetpateltech 2y ago

akanapuli 2y ago
Wondering what made Anthropic to change their stand from saying before that it is not secure to use web with AI models
- aprilthird2021 2y ago
  Fear of AI Winter probably
matt3210 2y ago
Does the LLM look at our click ads? If not, it’s a self destructive technology that will get itself blocked as it consumes resources in an unsustainable way
morisil 2y ago
I added this functionality already some time ago in my Claudine agent: https://github.com/xemantic/claudine/ https://github.com/xemantic/claudine/ It costed roughly 30 lines of code: https://github.com/xemantic/claudine/blob/main/src/commonMain/kotlin/ToolUse.kt#L120 https://github.com/xemantic/claudine/blob/main/src/commonMai...
- mcoliver 2y ago
  Kind of I guess? You should be more explicit that you're funnelling everything to through jina.ai
msp26 2y ago
> in feature preview for all paid Claude users in the United States. Support for users on our free plan and more countries is coming soon US only
- smca 2y ago
  More countries soon.
ubicomp 2y ago
Excited to see this. I've really been enjoying Claude. It feels like a different, more creative flavor of experience than GPT. I use Claude a lot for dialogues and exploring ideas, like a conversational partner. Having web access will add an interesting dimension to this.
- robwwilliams 2y ago
  Ditto. I use Claude 3.7 to refine drafts of research papers and ask it “What have I missed?”. Now I can prompt Claude to ping PubMed and make sure that its suggested references are verified. Each citation/claim should be accompanied by a PMID or a DOI. I hope this works!
  - ubicomp 2y ago
    That's a great way to use it!
- lovehashbrowns 2y ago
  That's how I use it as well! It'll also occasionally hallucinate things, but much less often than other AI tools I've tried. But typically I'll just run things by it that I'm question myself about, or if I want to solidify a concept I'll ask it if my understanding is correct. It's also fun to ask the same question to multiple AI tools and see how the answers differ. Usually Claude is the most accurate and helpful, though.
Brusco_RF 2y ago
Excited to see how this compares to Perplexity or Gemini. I remember that ChatGPT used to be able to search the web, but last I checked it it couldn't. I wonder why they removed that feature
- 85392_school 2y ago
  Search was not removed from ChatGPT, although it can be glitchy at times.
  - BryantD 2y ago
    Also not all models support it. I think only gpt-4o and gpt-4o-mini support it, although I haven't triple checked that.
- newfocogi 2y ago
  ChatGPT can search the web (I just checked in my account). It appears to be available for all users (not just paid): https://help.openai.com/en/articles/9237897-chatgpt-search https://help.openai.com/en/articles/9237897-chatgpt-search
  - Brusco_RF 2y ago
    I definitely tried to web search with ChatGPT a few weeks ago and it couldn't. I don't think I'm making this up. Unless I suffered a TBI.
    - callamdelaney 2y ago
      It told me it can't search the web and then proceeded to search the web
    - cactusplant7374 2y ago
      About half my requests end up going to web search. But if you ask it for something specific like "find an X-ray image with an abnormality," then it refuses.
danirogerc 2y ago
Couldn't a lot of front-ends using Claude API do this already? What's new?
- dcre 2y ago
  If that's true, they are using a separate search API to get search results and feed it into a regular Claude API call. The difference here is that Anthropic is integrating it directly, like OpenAI and Google have. It doesn't look like it's in the API yet, but presumably that's coming. Then, as with gpt-4o and the Gemini models, you can make a single API call and it will do the searching for you and incorporate the results.
- simonw 2y ago
  This is a new product feature for https://claude.ai https://claude.ai and the Claude mobile and desktop apps.
- quinncom 2y ago
  Yes, via MCP integrations. https://www.anthropic.com/news/model-context-protocol https://www.anthropic.com/news/model-context-protocol
NBJack 2y ago
I wonder if it will actually respect the robots.txt this time.
- micromacrofoot 2y ago
  almost no one does, robots.txt is practically a joke at this point — right up there with autocomplete=off
  - Demiurge 2y ago
    In what circles is it a joke? Google bots seem to respect it on my sites according to logs.
    - otikik 2y ago
      Apparently, the regular search crawler does it, but the ai thingie doesn't.
      - supriyo-biswas 2y ago
        Huh? You can add Google-Extended[1] to opt out from Generative AI summaries. [1] https://blog.google/technology/ai/an-update-on-web-publisher-controls/ https://blog.google/technology/ai/an-update-on-web-publisher...
        micromacrofoot 2y ago
        Google will still scrape it for training data either way, this only impacts search results.
        supriyo-biswas 2y ago
        > Today we’re announcing Google-Extended, a new control that web publishers can use to manage whether their sites help *improve Bard and Vertex AI generative APIs*, including future generations of models that power those products.
firloop 2y ago
Any information on what search engine is powering it?
goatmeal 2y ago
kagi already lets me use claude to search the web. how is this different?
- whalesalad 2y ago
  kagi is searching the web for you, and then injecting the results into the context of the prompt.
  - callamdelaney 2y ago
    Are there any downsides to that approach? It seems like we're moving towards empowering llm's to interact with stuff as if that's better than us doing it for them - is it really? Eg say I want to build an agent to make decisions, shall I write some code to insert the data that informs the decision into the prompt, return structured data, and then write code to implement the decision? Or should I empower the llm do those things with function calls?
    - visarga 2y ago
      If you want deeper search, it needs to be able to iterate, plan, reason while searching.
hombre_fatal 2y ago
Aside, does anyone know of an app like Perplexity for surfing the news in a foreign language (language practice)? Perplexity's "Explore" tab translates its news to your local language, and its curated news items are all pretty interesting, but the problem is that there are so few of them. I seem to get maybe a dozen stories in a day. I paid their subscription for a month just to listen to the news on my walk, but didn't renew because of this. A foreign news site like BBC Mundo (Spanish) on the other hand barely has any stories outside of a few niches. Its tech section only has a few stories per week. Hmm, maybe I want a sort of RSS reader that AI-translates stories for me. But I don't really want to maintain a feed myself either. Apple News would probably do it since they also have good curation, but afaict they still don't support foreign news sources (why???).
- dolmen 2y ago
  Use a VPN to appear like being in the target country. Use a browser profile where you set the language preference to the one you target.
  - hombre_fatal 2y ago
    For which purpose?
    - deleted 2y ago
      [deleted]
- diggan 2y ago
  > Apple News would probably do it since they also have good curation, but afaict they still don't support foreign news sources (why???). ground.news includes sources from all sorts of countries, and also auto-translate headline and the intro, while you can still click to access the source article. Not affiliated, just happy user. Example with sources in English, German and French: https://ground.news/article/accident-on-the-a13-in-the-yvelines-the-results-and-profile-of-the-victims-of-the-collision-are-known_50ea75 https://ground.news/article/accident-on-the-a13-in-the-yveli... Although I'm not sure how useful it is for language learning, as you cannot (afaik) configure it to only display articles in Spanish or something similar, but if you filter by stories about France, you'll get a lot of French sources (obviously).
deleted 2y ago
[deleted]
mvieira38 2y ago
What's up with the geoblocking of Claude features? Not the first time it happens
- kasey_junk 2y ago
  Different geographies have different legal requirements.
- artursapek 2y ago
  ask the same geniuses who gave you the browser cookie popup re-implemented in a new way on every fucking website ever
itpcc 2y ago
Now I understand why Gitlab was (is?) attacked[0] by those hideous bots. [0] https://news.ycombinator.com/item?id=43422413 https://news.ycombinator.com/item?id=43422413
pcj-github 2y ago
Does not really say /how/ it's performing a web search... Is it tapping into it's "own" corpus of material or calling out to some other web search engine?
- ordersofmag 2y ago
  In my quick experiment (asking a question that would naturally lead to content on my own site) it is not doing a real time request to the site in question. Its answer included links back to my site (and relevant summaries), but there was no requests for those pages while it was generating its answer. So it's clearly drawing from info that has already been scraped at some earlier point. And given that I see Claudebot routinely (and politely) crawling the site I'd guess it's working from it's own scraped copies (because why use someone else's if you've got your own....)
  - gizmodo59 2y ago
    Major AI players don’t want to use someone else web index as they may cut it off or jack up the prices etc. major players want to build their own web index
    - hk__2 2y ago
      And this is why we see our logs overloaded with ABot BBot CBot etc, every single "AI" company makes their own bot and they all crawl the same pages over and over.
punkpeye 2y ago
There is already a 100 ways of doing it using MCP https://glama.ai/mcp/servers?searchTerm=search https://glama.ai/mcp/servers?searchTerm=search What's the benefit of bringing native integration?
- TrueDuality 2y ago
  The native app that allows for MCP is only available officially on Mac's and the web interface is generally more convenient for non-technical users. Searching and interacting with the web has become a table-stakes feature and was a glaring gap in Claude.
  - punkpeye 2y ago
    Let me rephrase it. MCP has the capability to add this functionality. It would be nice to see MCP getting adoption in their web UI, as well easier UX, rather than more ad hoc features being added natively.
    - masterj 2y ago
      This is likely implemented behind the scenes as an MCP server exposed to their model in the web UI. It is likely that they will enable MCP servers over HTTP+SSEs (vs the stdin/stdout used with Claude desktop) on the web version in the near future.
light_triad 2y ago
Good news. I integrated Claude with a scrapper to get info from pages and it was not giving hallucinations 99% of the time. Hope this works out of the box now.
blensor 2y ago
Funny thing is that I have the obsidian-mcp-tools installed and today claude-desktop just starting fetching stuff from the web through that because it exposes a fetch tool to claude. So this limitation is a bit arbitrary anyway.
ProofHouse 2y ago
Awesome, but I also do want to say it’s pretty sad it took this long straight up. Literally no excuse. But I’m glad they finally got to a feature that was launched more than a year ago on competitors.
McNutty 2y ago
I haven't used Claude yet, but heard many good things. So I'm surprised to see that they're so far behind on this feature.
deleted 2y ago
[deleted]
ignoramous 2y ago
These are interesting times. It wasn't long ago that a uni senior who worked for a decade+ on Google Search told me that it was hopeless anyone tries to compete with Google not because it sees a tonne of signals that helps with IR but because of its in-house AI/ML. It turns out that the org that built the ultimate AI/ML that runs rings around anything that came before it for NLP (and thus IR) was a sister team at Google Translate. It isn't inconceivable that a kid might be able to build a Google-quality web search, scalability aside, on CommonsCrawls data in a weekend. As someone who built re-ranking algorithms for a search engine built atop Yahoo! and Wikipedia (REST/SOAP) APIs back in the late 2000s as a side project (and experienced the launch and subsequent iterations of Echo/Alexa up close at Amazon), the current capabilities (of even the open weight multi-modal models) seem too good to be true. Google itself though is saved by its enormous distribution advantages afforded by Chrome (3B to 5B users) and Android (3B+), aside from its search deals with Apple and other browser vendors.
fourside 2y ago
I’ll be interested in trying it. My admittedly limited experience with this on ChatGPT has been disappointing. ChatGPT falls for the SEO content that has taken over the web. As an example, I recently travelled abroad to a popular vacationing spot and asked ChatGPT for local recommendations on what to do. When it gave me answers directly, they were pretty solid. But when it “searched the web” instead, the answers were awful. Every single result it suggested had terrible ratings. It did this repeatedly. One of those times I asked it to pick something with better ratings and it sort of improved but not by much. Of course this is another tool and maybe Claude uses better sources or a better algorithm, but in this case where there was a concrete number tied to the results, that while not perfect, aims to rate the quality of a result, it still did not filter out low quality answers. I’m not sure I trust these LLMs to do any better when there aren’t such ratings available. The available input data is just not very good, and now LLMs are being used to feed that low quality, SEO machine.
mediumsmart 2y ago
thats great - the web he has been trained on or the one from Google?
tttym 2y ago
It's like a line of platforms waiting for their own agents for web search
rgbrgb 2y ago
Is there a way to access the new web browsing capability via API?
- simonw 2y ago
  Not yet, and no hints as to whether that will happen or not.
sylware 2y ago
What I really would like to know: do they use a web crawler with an AI strapped to the mouse and keyboard of a javascript-ed web engine?
deadbabe 2y ago
Is no one concerned about LLMs just feeding people SEO ads as content?
ConanRus 2y ago
finally
tantalor 2y ago
It says a lot about their product vision and intended market that the example query is typescript migration question. Do they not care about typical search users? Only developers?
- Matl 2y ago
  I'd guess they showed that query because LLMs are a lot better at answering translation/migration type stuff without hallucinating too much.
  - dontlikeyoueith 2y ago
    That's because the attention mechanism was designed for Seq2Seq models (i.e. translation in its most general form). Any other use of it is a case of "I have a hammer, so that's a nail".
- picafrost 2y ago
  Do users pay for LLMs? I haven't seen much concrete data indicating that they do. I don't think the casual utility gains of LLMs have gotten average people so much value that they're paying $20/mo+ for it. Certainly not for search in the age of [doom] scrolling. I would guess that Anthropic wants developers talking about how good Claude is in their company Slack channels. That's the smart thing to do.
  - pixl97 2y ago
    Have you actually done any kind of study on the utility the 'average user' has received, or is this just guessing?
    - picafrost 2y ago
      I have only anecdotal data from non-technical friends and family. I’m referring to average people who may not be average users because they’re barely using LLMs in the first place, if at all. They have maybe tried ChatGPT a few times to generate some silly stories, and maybe come back to it once or twice a month for a question or two, but that’s it. We’re all colored by our bubbles, and that’s not a study, but it’s something.
jetrink 2y ago
> With web search, Claude has access to the latest events and information, boosting its accuracy on tasks that benefit from the most recent data. I'm surprised that they only expect performance to improve for tasks involving recent information. I thought it was widely accepted that using an LLM to extract information from a document is much more reliable than asking it to recall information it was trained on. In particular, it is supposed to lead to fewer instances of inventing facts out of thin air. Is my understanding out of date?
- not_good_coder 2y ago
  I have found that for RAG use cases where the source can be document or web data, hallucinations can still occur. This is largely driven by the prompt and alignment to the data available for processing and re-ranking.
beezle 2y ago
At this point it is probably easier to poison web pages for AI crawlers in a way that does not taint the human experience.
ilaksh 2y ago
I've been using Tavily's search API for my MindRoot agents. Seems to work fairly well and much easier to set up than Google's search API. Anyone know if there is something better? I was thinking of trying Perplexity maybe.
tgtweak 2y ago
Feels like a catch-up feature to chatgpt... honestly the biggest holdback for me on anthropic is the output token limit on sonnet... 8000 tokens max output is really limited (and 200k tokens in) compared to other offerings - especially considering that I suspect most sonnet users are not chat-users but api users.
- simonw 2y ago
  The output limit of Claude 3.7 Sonnet Thinking is much higher (128,000): https://simonwillison.net/2025/Feb/25/llm-anthropic-014/#a-massively-increased-output-limit https://simonwillison.net/2025/Feb/25/llm-anthropic-014/#a-m...
  - tgtweak 2y ago
    This is actually very helpful to me! Thanks for posting!
bfeynman 2y ago
why does perplexity exist anymore? They were one of anthropic's biggest customers and had been finetuning claude models for search for a while.
NewJazz 2y ago
Bizarre that they choose to publish this right as a thread criticizing AI crawlers gets bumped off the front page. https://news.ycombinator.com/item?id=43422413 https://news.ycombinator.com/item?id=43422413
- dewey 2y ago
  There’s so many news about anything “AI” at any given moment that there will never be a perfect moment.
  - NewJazz 2y ago
    But this feature directly contributes to the problem in the article I linked.
tcdent 2y ago
Searching the web is a great feature in theory, but every implementation I've used so far looks at the top X hits and then interprets it to be the correct answer. When you're talking to an LLM about popular topics or common errors, the top results are often just blogspam or unresolved forum posts, so the you never get an answer to your problem. More of an indicator that web search is more unusable than ever, but interesting that it affects the performance of generative systems, nonetheless.
- Almondsetat 2y ago
  >looks at the top X hits and then interprets it to be the correct answer. LLMs are truly reaching human-like behavior then
  - yoyohello13 2y ago
    The longer I've been in the workforce, the more I realize most humans actually kind of suck at their jobs. LLMs being more human like is the opposite of what I want.
    - _heimdall 2y ago
      That could very well be because the jobs are effectively useless. By no means does that mean the people are, nor is what the income allows them to do. But most jobs sure do seem pointless.
      - homarp 2y ago
        https://news.ycombinator.com/item?id=36373190 https://news.ycombinator.com/item?id=36373190
      - bravetraveler 2y ago
        The work is mysterious and important
        2y ago
CalChris 2y ago
I find myself Googling less often these days. Frustrated with both the poor search results and impressed with the quality of AI to do the same thing and more, I think search's days are numbered. AOL lasted as an email address for quite some time after America Online ceased to be a relevant portal. Maybe Gmail will as well.
- whalesalad 2y ago
  Kagi has been really really good.
- puttycat 2y ago
  Agree and I'm pretty sure Google is seeing this drop internally in usage stats and are panicking. I'm also certain (but hope to be wrong) that because of this they'll be monetizing the hell out of every remaining piece of product they have (not by charging for it of course).
- noisy_boy 2y ago
  I am still googling for non-indepth queries because the AI-generated summary at the top of the results is good enough most of the time and actual results are just below in case I want to see them. For more in-depth stuff, it is LLMs by default and I only goto Google when the LLM isn't getting me what I need.
  - borgdefenser 2y ago
    I notice I have been using the Google AI summary more and more for quick things. I had subscribed to Perplexity for a month to use their deep research. I think it ran out earlier this week but I am really missing it Saturday morning here. That thing is awesome. Sonnet 3.7 is more in the middle of this to me. It can help me understand all the things I found from my deep research requests. I am surprised the hype is not more for Sonnet 3.7 honestly.
joshstrange 2y ago
Massive props to Anthropic for announcing a feature _and_ making it available for everyone right away. OpenAI is so annoying in this aspect. They will regularly give timelines for rollout that not met or simply wrong. Edit: "Everyone" = Everyone who pays. Sorry if this sounds mean but I don't care about what the free tier gets or when. As a paying user for both Anthropic and OpenAI I was just pointing out the rollout differences. Edit2: My US-bias is showing, sorry I didn't even parse that in the message.
- underdeserver 2y ago
  It's not available for everyone.
  - joshstrange 2y ago
    > Web search is available now in feature preview for all paid Claude users in the United States. It is for all paid users, something OpenAI is slow on. I pay for both and I often forget to try OpenAI's new things because they roll out so slow. Sometimes it's same-day but they are all over the map in how long it takes to roll out.
    - deivid 2y ago
      For all paid users _in America_. It's not available for me in Europe.
      - joshstrange 2y ago
        Apologies, I updated my original comment, I missed that completely.
      - DrammBA 2y ago
        I think 'For all paid users in the United States' is clearer. I live in America, but not in what the United States considers 'America', so I do not get to use this new feature yet.
g42gregory 2y ago
Anybody knows if this search will works inside Cursor? Do we need to do anything to make 3.7-thinking to search the web?
- dimitri-vs 2y ago
  You can already @web and have been able to for a while now. It's not very good IMO. https://docs.cursor.com/context/@-symbols/@-web https://docs.cursor.com/context/@-symbols/@-web
nimish 2y ago
So what's perplexity's raison detre at this point?
- dalmo3 2y ago
  I open perplexity, I see a search box. I open claude, I see a big "Continue with Google" button.
scudsworth 2y ago
"claude can now ddos random websites . . . more so"
douglee650 2y ago
You know what Claude can't do? Successfully vibe me a solution to: """ i need a bashrc command that will map the alias "logg" to open macvim to the file at ~/log.txt, then execute the macro defined by "<leader>z" """ Note <leader>z ends with user in insert mode, Claude provides solution below but puts me in edit mode. (I still have to press "i") alias loggg='mvim ~/log.txt -c "normal \<leader>z"'
- simonw 2y ago
  I don't find that prompt to be particularly clear.
  - dcre 2y ago
    And it did exactly what the prompt asked! For all it knows, the macro could put the user in the desired mode.
  - douglee650 2y ago
    I guess I am expecting too much. But dang, comment reply from simonw!
hansmayer 2y ago
So, referring specifically to the example they show on the front-page, what value does this bring actually? The best example they could come up with is Typescript migration ? Really? Weren't the LLMs supposed to be a superior alternative to searching the web? Why do we need to produce more CO2 to do the same we could have done at the fraction of the cost, of course at the time when the google search was still working?
- simonw 2y ago
  The CO2 concerns of using LLMs are massively overblown these days (with the exception of o1-pro and GPT-4.5 at least). The energy efficiency of most models has improved by an order of magnitude since the most widely cited CO2 usage papers were published. (It remains frustratingly difficult to get accurate numbers though: at this point I think more transparency would help rather than hurt the big AI labs)
  - cube2222 2y ago
    A good recent in-depth article about this: https://andymasley.substack.com/p/individual-ai-use-is-not-bad-for https://andymasley.substack.com/p/individual-ai-use-is-not-b...
  - hansmayer 2y ago
    I meant that as a side note, but even if we put the CO2 issue completely aside, I am still failing to see what is this "feature" bringing, and judging by the lame example they picked, the Anthropic are not quite sure either.
wewewedxfgdf 2y ago
I'm waiting for Claude's API to support projects with file uploads like its web UI.
ralusek 2y ago
Best models for search, in order: OpenAI Deep Research Grok Deep Search Gemini Deep Research Grok + Search Gemini + Search ChatGPT + Search These are just my opinions, but I do use this feature all the time. Haven't used Claude enough to get a sense of where it would fit in.
- danielbln 2y ago
  Where does Perplexity Deep Research fit into this list?
gcanyon 2y ago
Funny, I literally just two days ago asked Claude to provide an outline of the functionality of a product, giving it the web site. It of course refused. So I downloaded the text of the site and passed that in, and got mediocre results. The results based on giving the source URL directly were better. Still a bit generic and high-level and vague, as LLMs tend to be, but better than the text-download version a couple days ago. And of course much easier to generate!
- MattSayar 2y ago
  I had tried using monolith [0] to feed webpages into Claude but all the html was too much token context. I ended up Print > Save as PDF-ing somewhat often and that worked pretty well. But just giving a URL is ideal. [0] https://github.com/Y2Z/monolith https://github.com/Y2Z/monolith
  - knowaveragejoe 2y ago
    Using the fetch MCP tool(which is very basic) works fairly well for me, though various sites will block it from time to time. https://github.com/modelcontextprotocol/servers/tree/main/src/fetch https://github.com/modelcontextprotocol/servers/tree/main/sr...
    - MattSayar 2y ago
      > though various sites will block it from time to time. The page itself describes a --ignore-robots-txt and customizing the user agent. Guess we can just all copy OpenAI and continue to make SourceHut's life miserable /s This is a cool tool, thanks for sharing
      - knowaveragejoe 2y ago
        For what it's worth, it's fetch under the hood. More akin to curl than automated scraping.
ForTheKidz 2y ago
Great, now we just need a decent search engine.
artembugara 2y ago
Search the web is apparently using SERP. It’s just breaks my head. We’ve build LLMs that can process millions of pages at a time. But what we give them is a search engine that is optimized for humans. It’s like giving a humanoid robot access to a keyboard with a mouse to chat with another humanoid robot. Disclaimer: I might be biased as we’re kind of building the fact search engine for LLMs.
- sadeshmukh 2y ago
  No LLM can process millions of web pages. Maybe you're thinking of something else?
- braebo 2y ago
  This is a problem I think about often. I’d be curious to know what kind of things you’ve learned / accomplished in that problem space so far.
- ordersofmag 2y ago
  What makes you think Claude is using a search engine optimized for humans?
_ea1k 2y ago
I really want these to be able to find and even redisplay images. "Search all the hotels within 5 miles of this address and show me detailed pictures of the rooms and restrooms" Hotels would much rather show you the outside, the lobby, and a conference room, so finding what the actual living space will look like is often surprisingly difficult.
- dgs_sgd 2y ago
  I've been looking for this as well. I want a reliable image search tool. I tried a combination of perplexity web search tool use with the Anthropic conversations API but it's been lackluster.
  - deleted 2y ago
    [deleted]
  - tjsk 2y ago
    I’ve been experimenting with different LLM + search combos too, but results have been mixed. One thing I’m particularly interested in is improving retrieval for both images and videos. Right now, most tools seem to rely heavily on metadata or simple embeddings, but I wonder if there’s a better way to handle complex visual queries. Have you tried anything for video search as well, or are you mainly focused on images? Also, what kinds of queries have you tested?
Taters91 2y ago
so can I
greatNespresso 2y ago
Woaw, so excited about this! Has anyone tried it out already?
ineedaj0b 2y ago
i stopped using Claude about 2 months ago. went to Grok (the code was better, everything was better - politics aside). i wonder if this update will improve it. the main issue i find with Claude is, he fights you. He refuses so many requests and i need 3 or 4 replies to get what i want vs deepseek/grok. i've kept the monthly subscription to help anthropic, but it's trounced by the free options imo.
- Workaccount2 2y ago
  Claude 3.7 with thinking is a big step up. If you haven't used it I'd suggest giving it a try. I have used grok a bit and it did what I needed it too, so I can't really compare. But 3.7 thinking is crazy strong for coding.
  - gizmodo59 2y ago
    I got much better results with o3-mini than Claude for coding. Get the high level design wkth o3 or o1 and then use gpt4 or Claude for small tasks.
  - user_7832 2y ago
    I wonder if you use it exclusively for coding, because for general purpose explanation tasks, 3.7 seems absolutely terrible unfortunately. Back when it was 3.5 you could actually talk and learn things and it felt humane, but now it sounds like a McKinsey-corpo in a suit who sounds all fancy but is only right half the time. I’ve switched back (rather regretfully) to chatgpt, and holy hell is its personality much better. For example just try asking it to explain differences between Neo Grotesque and Geometrical Sans Serif fonts/typefaces. One sounds like a friend trying to explain, the other sounds like a soulless bot. (And if you have 3.5 access, try asking it too.)
    - Workaccount2 2y ago
      I use it just for coding. For general inference I use 4.5 I think OpenAI (and likely others) are on the right to track to acknowledge that different model tunings are best for different uses, and they interned to add a discriminator that can direct prompts to the best tuned model/change model tuning in real time.
monkeydust 2y ago
Which frontier model provider let's me specific what websites to search and it will only search those?
- gizmodo59 2y ago
  You can just prompt ChatGPT 4o saying only get information from web
  - monkeydust 2y ago
    Yes but you cant limit to a set of websites, I have tried sometimes it works but rarely and if it does search your set it will still go off and pick others. In the field I work in there are around a dozen specialist sites and I just want it to query those. Perhaps I need to develop around it.
lihua919 2y ago
great
Heidaradar 2y ago
Kinda surprised it took them this long to add this feature, but glad it's here now
stealthlogic 2y ago
[dead]
jason_zig 2y ago
Curious - does anyone want this stuff?
- gavmor 2y ago
  Yeah, I love this stuff! Compiling data from multiple pages into a single paragraph in the time it takes to read one page? Great stuff. I can't imagine living without Perplexity. Oh, sure, it hallucinates a lot, and in dangerous ways, but even if I have to manually corroborate all the citations, I'm still saving time, especially insofar as it reveals whether or not I'm barking, broadly, up the wrong tree. It's especially good for comparisons, because the results of two disparate search terms can be collated into the results. Could this be done without LLMs, but only vector embeddings? Hm, maybe. Algolia is maybe the 80 for 20, but does Algolia have a web index?
l33tbro 2y ago
I still don't get why Claude needs my phone number to sign up. Feels gross and is a such a shame, as their LLM seems great.
nokun7 2y ago
Honestly, while this is a great update and all, other AI platforms have had web search functionality for quite some time now. Any explanation for this delay? I wonder if Claude’s API will match Perplexity’s dynamic answers. Is there API rate limiting. If so, then the older API pricing would be preferable. Can users switch between the two?
livingmylife01 2y ago
This is insane. Guys you think it will someday replace google?
dangapeass 2y ago
[dead]
cpersona 2y ago
SEO for LLMs looks to have a bright future.
- gavmor 2y ago
  How do LLM queries differ from organic?
luxuryballs 2y ago
Time to ask it to find all the dirt on me?
xingwu 2y ago
Hope there will be a tech blog regarding how you index and retrieve the pages.
d--b 2y ago
Next: Claude can now ask random questions to strangers on Reddit.
n_ary 2y ago
Off-topic: Mistral already had web search enabled for a while on there free tier. Caveat: Mistral reasoning model on free tier is super slow(2-5 token/sec).
ingen0s 2y ago
Can’t believe they are making us vpn for this
herdcall 2y ago
It badly hallucinated in my test. I asked it "Rust crate to access Postgres with Arrow support" and it made up an arrow-postgres crate. It even gave sample Rust code using this fictional crate! Below is its response (code example omitted): I can recommend a Rust crate for accessing PostgreSQL with Arrow support. The primary crate you'll want to use is arrow-postgres, which combines the PostgreSQL connectivity of the popular postgres crate with Apache Arrow data format support. This crate allows you to: Query PostgreSQL databases using SQL Return results as Arrow record batches Use strongly-typed Arrow schemas Convert between PostgreSQL and Arrow data types efficiently
- keeran 2y ago
  This was pretty much my first experience with LLM code generation when these things first came out. It's still a present issue whenever I go light on prompt details and I _always_ get caught out by it and it _always_ infuriates me. I'm sure there are endless discussions on front running overconfident false positives and being better at prompting and seeding a project context, but 1-2 years into this world is like 20 in regular space, and it shouldn't be happening any more.
  - op00to 2y ago
    Often times I come up with a prompt, then stick the prompt in an LLM to enhance / identify what I’ve left out, then finally actually execute the prompt.
  - exhaze 2y ago
    Cite things from ID based specs. You’re facing a skill issue. The reason most people don’t see it as such is because an LLM doesn’t just “fail to run” here. If this was code you wrote in a compiled language, would you post and say the language infuriates you because it won’t compile your syntax errors? As this kind of dev style becomes prevalent and output expectation adjust, work performance review won’t care that you’re mad. So my advice is: 1. Treat it like regular software dev where you define tasks with ID prefixes for everything, acceptance criteria, exceptions. Ask LLM to reference them in code right before impl code 2. “Debug” by asking the LLM to self reflect on its decision making process that caused the issue - this can give you useful heuristics o use later to further reduce the issues you mentioned. “It” happening is a result of your lack of time investment into systematically addressing this. _You_ should have learned this by now. Complain less, learn more.
blazenby 2y ago
[dead]
uzyn 2y ago
Surprised that Claude (the app, not model) not only has done well for so long, but has somewhat consistently clinched the top spot in coding, all without a feature that is considered somewhat of a basic feature for most consumer-facing AI apps.
- gizmodo59 2y ago
  How much % it’s significant compared to say openai or google? Because if I’m paying 20$ I want other things too not just coding. And if the moat for coding compared to other vendors is not significant, it doesn’t make any difference tbh
  - uzyn 2y ago
    Fair point. I wouldn't say it's by a lot because I am getting quite good results with ChatGPT's models too. A part of it could also just be confirmation bias too.
hoppp 2y ago
I just read about llm bots ddosing websites and i guess more of that is coming soon. Big money is bettin on AI eatin the web and the small fishes pay for the bandwidth.
whatever1 2y ago
Is it fair use if Claude makes google searches and then presents the results to its users ?
ggm 2y ago
So in many respects, search the place it used to construct the model? Isn't that functionally bias-reinforcing? "Look what I synthesise is correct and true because when I use the same top 10 priming responses which informed my decision I find these INDEPENDENT RESULTS which confirm what I modelled" type reasoning. None of us have a problem with an LLM which returns 2+2 = 4 and shows you 10 sites which confirm. What worries me is when the LLM returns 2+2 = 5 and shows 10 sites which confirm. The set of negative worth content sites is semi infinite and the set of useful confirmed fact (expensive) sites is small so this feels like an outcome which is highly predictable (please don't beat me up for my arithmetic) e.g. "Yes Climate science is bunk" <returns 10 top sites from paid shills in the oil sector which have been SEO'd up the top>"
- shortrounddev2 2y ago
  We will very quickly enter a Kepler effect of information on the internet. All text on the internet will become AI slop being parsed by AI. Real information and human beings will be drowned out by the garbage. The internet will cease to be useful and we will retreat to corners of the web or to walled gardens. I'm seeing more and more online communities these days enforce invite only because there's just too much AI slop everywhere now.
  - importantstuff 2y ago
    Do you mean Kessler syndrome by any chance?
    - shortrounddev2 2y ago
      Yes! And I would edit my original comment if HN wasn't such a POS site!
notepad0x90 2y ago
if everyone is using LLMs to solve problems, in a few years, won't LLMs run out of content to mine? In short, how can the general dumbing down of LLMs and degradation of content used to solve problems be avoided over the long term? For questions about events and problems that arose after 2025, where would LLMs get information to solve those? and who would be asking those at a forum LLMs can access going forward? Is the snake eating it's own tail?
- kadushka 2y ago
  1. People will continue to answer questions and post about events and problems after 2025. Eventually LLMs themselves (inside robots) will be observing the world and reporting on anything interesting. 2. Best LLMs today answer questions better than 90% of people who comment on forums. So if these LLMs have been able to train on all the crap posted on internet so far, they should only get better as they are being trained on high quality output from the latest (and future) LLMs.
- visarga 2y ago
  Most interesting data will be collected in chat rooms and apps. There are over a billion LLM users, they act as human-in-the-loop enhancig the LLM, sometimes testing ideas even in reality. Wondering what providers are doing with the chat logs.
stephencoyner 2y ago
When I try to prompt it with something that obviously needs up to date web search (when will Minneola Tangelos be in season this year?) it says.. "I believe they're usually available from November through March, but I'm not completely certain about the exact timing for this year's crop. Would you like me to search for more current information about the 2025 tangelo season?" It doesn't just search, it wants me to confirm. This has happened a lot for me.
themagician 2y ago
What is there to even search anymore? Almost everything is gated, and whatever remains public is connected a faucet that pumps out AI slop at an ever increasing rate. The internet consumed itself. Telling someone to, "Just Google it," is now terrible general advice.
bosky101 2y ago
We need a way to collapse comments on HN
- krapp 2y ago
  see the "[-]" link in the comment header? That's what it does.
- 4ggr0 2y ago
  > created: February 20, 2007 i hope you're trolling mate, got an account since 18 years and never wondered what the [-] button does? :D
- bosky101 2y ago
  OMG!
zxvkhkxvdvbdxz 2y ago
Wake me up when we go back to discussing progress, instead of being wooed by fake toddlers doing tricks badly.
AzzyHN 2y ago
They never watched Avenger's 2
DeathArrow 2y ago
Do they have their own search engine or use an external one. If they use Google I would worry about relevance.
Tewboo 2y ago
This is a huge step forward for AI. Can't wait to see how Claude integrates with other apps.
startifyai 2y ago
[dead]
joeeverjk 2y ago
Funny how we’ve come full circle—LLMs now search the web to answer queries, which is what search engines did originally. The difference? Now the hallucinations come with citations. Curious how long until "web search" just means summarizing Reddit threads again.
mbs159 2y ago
Will this work for people using Claude through other services like OpenRouter?
iamflimflam1 2y ago
I generally have to resort to telling ChatGPT “do not search the web”. ..
ksajadi 2y ago
I can hear the sigh of relief from "SEO gurus" from here...
Cort3z 2y ago
I usually find Claude to be my favourite flavor of LLMs, but I still pay for ChatGPT because their voice offering is so great! I regularly use it as an "expert on the side" when I do other things, like doing bike repairs. I ask it things like "how do I find the min/max adjustments on my particular flavor of front derailleur", or when cooking, and my hands are dirty, I can ask stuff like "how much X do I usually need for Y people", and so on. The hands-off feature is so great when my hands are literally busy doing some other thing. I really wish Claude had something similar.
- eraserj 2y ago
  > There's less usage of voice mode on the enterprise and power users side but that will happen eventually. - Anthropic CEO 21 jan. [0] [0] https://youtu.be/snkOMOjiVOk https://youtu.be/snkOMOjiVOk 01:30
- mock-possum 2y ago
  ChatGPT advanced voice mode really is surprisingly excellent - I just wish it: 1) would give you more time to pause when you’re talking before it immediately launches into an answer 2) would actually try to say the symbols in code blocks verbatim - it’s basically useless for looking up anything to do with code, because it will omit parts of the answer from its speech.
  - barfingclouds 2y ago
    Yeah I have to manually hold it down every time I talk. I have a lot of pauses and simply would not be able to interface with that without that option. It’s why I essentially can’t use Gemini voice mode
- lamtung 2y ago
  Is it possible to use ChatGPT voice feature in a similar manner to Alexa where I only need to say an activation word? I’m aiming to set up a system for my 7-year-old son to let him engage in conversations with ChatGPT as he does with Alexa.
  - 2y ago
andreygrehov 2y ago
Two things. 1. I generally prefer that an LLM not search the web. The top N results are often either SEO spam, excessively long articles created solely to rank well, or long-established websites that gained authority years ago, when Google's crawler and ranking algorithms were less sophisticated. 2. Web search by LLMs is likely here to stay, so I'm curious whether there's an agent-friendly web format. For example, when an RSS reader visits a website, the site responds with an RSS feed. I think we need something similar for agents - an open standard that all websites would support. This could reduce processing overhead and potentially improve the accuracy of the information retrieved. Thoughts?
- mstaoru 2y ago
  You already answered #2 with #1. The standard will be gamed.
  - andreygrehov 2y ago
    But the purpose of the standard isn't to rank websites, but to process the information.
dankobgd 2y ago
wow so cool and usefull, said nobody ever
BrouteMinou 2y ago
I, too, can search the web. We finally went full circle? LLM is used as a search engine?
agentultra 2y ago
They need to stop or else make their crawlers easy to identify and block. However I have no faith that AI companies will play by the rules. They already cost people time, money, and their mental health by using adversarial tactics to evade blocking and ignoring robots.txt https://drewdevault.com/2025/03/17/2025-03-17-Stop-externalizing-your-costs-on-me.html https://drewdevault.com/2025/03/17/2025-03-17-Stop-externali...
enveks 2y ago
[dead]
dostick 2y ago
Anyone noticed that if you enable the “browse internet” in ChatGPT, it becomes very dumb? It abandons all its intelligence and produces mostly incorrect results. Like it’s being passive-aggressive, “Oh, you don’t like me as I am and want to augment me with search, let me show you how it is if my brain was only search!”
deleted 2y ago
[deleted]
BaculumMeumEst 2y ago
Can you search the web for probable corrections to broken links? Has anyone had luck doing this with a web enabled model?
mocmoc 2y ago
Please , make your context window bigger , if you do that … that’s it sonet 3.7 it’s amazing but it can’t even finish a dashboard because of that
simonw 2y ago
The search index is provided by Brave: https://simonwillison.net/2025/Mar/21/anthropic-use-brave/ https://simonwillison.net/2025/Mar/21/anthropic-use-brave/ - Brave is now listed as a subprocessor on the Anthropic Trust Center portal - Search results for "interesting pelican facts" from Claude and Brave were an exact match - If you ask Claude for the definition of its web_search tool one of the properties is called "BraveSearchParams"
- sebmellen 2y ago
  Remarkably, it looks like Brave will survive even while Basic Attention Token is essentially dead. What an interesting pivot.
- sumeno 2y ago
  Very disappointing, Brave is the last company I want my data going to
  - newswasboring 2y ago
    Why? I am not aware of what's wrong with them.
    - sumeno 2y ago
      https://en.wikipedia.org/wiki/Brave_(web_browser)#Controversies https://en.wikipedia.org/wiki/Brave_(web_browser)#Controvers...
  - exhaze 2y ago
    Install MCP plugin and call a search engine of your choice. If you’re unhappy about something, try to first think of a solution before expressing your discontent.
    - sumeno 2y ago
      Wow, so condescending I don't use the desktop app and I don't want to use the desktop app or jump through a bunch of hoops to support basic functionality without having my data sent to a sketchy company.
dunefox 2y ago
A bit OT: does anyone have experiences with Mistral AI as a comparison to OpenAI or Anthropic? I would like to stay with a European company, if they're somewhat equivalent.
- simonw 2y ago
  I really like the Mistral openly licensed models - Mistral Small 3 is my current favourite local model to run, but only because I've not spent enough time with the brand new Mistral Small 3.1 to recommend it yet (I expect it will be promoted to my favourite local model soon.) Their user-facing product at https://mistral.ai/ https://mistral.ai/ seems good to me - it uses Brave for search (same as Claude does) and has a "canvas" feature similar to Claude Artifacts. I've not spent enough time with that to evaluate if it could be a good daily-driver or not though. My hunch is that Claude 3.7 Sonnet is still _massively_ better for code, based on general buzz online and a few benchmarks I've seen.
pixelkink 2y ago
Not to sound snarky but Anthropic introduced function calling over a year ago... The capability was always there for someone that wanted to spend a weekend coding a tool for it. https://www.anthropic.com/news/claude-3-family?_hsenc=p2ANqtz--7E9rghpH8hgDEBV2C5pyiXXeAIJY6LnrVppijwY-3E1T3PURd5sLMLgkuo5131igbto6Y https://www.anthropic.com/news/claude-3-family?_hsenc=p2ANqt...
- mark_l_watson 2y ago
  I agree. I have been integrating Brave search and DuckDuckGo search with LLMs for about a year. That said it is so much more convenient having an option of having it built in. I stopped paying for Perplexity a year ago, but a month ago I started using Perplexity's combined search+LLM APIs - reasonably priced and convenient.
hackburg 2y ago
[dead]
rmwa 2y ago
Finally - but it will make Claude even better for coding
deleted 2y ago
[deleted]

1233 points by meetpateltech 2y ago

akanapuli 2y ago

Wondering what made Anthropic to change their stand from saying before that it is not secure to use web with AI models

aprilthird2021 2y ago
Fear of AI Winter probably

matt3210 2y ago

Does the LLM look at our click ads? If not, it’s a self destructive technology that will get itself blocked as it consumes resources in an unsustainable way

morisil 2y ago

I added this functionality already some time ago in my Claudine agent: https://github.com/xemantic/claudine/ https://github.com/xemantic/claudine/ It costed roughly 30 lines of code: https://github.com/xemantic/claudine/blob/main/src/commonMain/kotlin/ToolUse.kt#L120 https://github.com/xemantic/claudine/blob/main/src/commonMai...

mcoliver 2y ago
Kind of I guess? You should be more explicit that you're funnelling everything to through jina.ai

msp26 2y ago

> in feature preview for all paid Claude users in the United States. Support for users on our free plan and more countries is coming soon US only

smca 2y ago
More countries soon.

ubicomp 2y ago

Excited to see this. I've really been enjoying Claude. It feels like a different, more creative flavor of experience than GPT. I use Claude a lot for dialogues and exploring ideas, like a conversational partner. Having web access will add an interesting dimension to this.

robwwilliams 2y ago
Ditto. I use Claude 3.7 to refine drafts of research papers and ask it “What have I missed?”. Now I can prompt Claude to ping PubMed and make sure that its suggested references are verified. Each citation/claim should be accompanied by a PMID or a DOI. I hope this works!
- ubicomp 2y ago
  That's a great way to use it!
lovehashbrowns 2y ago
That's how I use it as well! It'll also occasionally hallucinate things, but much less often than other AI tools I've tried. But typically I'll just run things by it that I'm question myself about, or if I want to solidify a concept I'll ask it if my understanding is correct. It's also fun to ask the same question to multiple AI tools and see how the answers differ. Usually Claude is the most accurate and helpful, though.

Brusco_RF 2y ago

Excited to see how this compares to Perplexity or Gemini. I remember that ChatGPT used to be able to search the web, but last I checked it it couldn't. I wonder why they removed that feature

85392_school 2y ago
Search was not removed from ChatGPT, although it can be glitchy at times.
- BryantD 2y ago
  Also not all models support it. I think only gpt-4o and gpt-4o-mini support it, although I haven't triple checked that.
newfocogi 2y ago
ChatGPT can search the web (I just checked in my account). It appears to be available for all users (not just paid): https://help.openai.com/en/articles/9237897-chatgpt-search https://help.openai.com/en/articles/9237897-chatgpt-search
- Brusco_RF 2y ago
  I definitely tried to web search with ChatGPT a few weeks ago and it couldn't. I don't think I'm making this up. Unless I suffered a TBI.
  - callamdelaney 2y ago
    It told me it can't search the web and then proceeded to search the web
  - cactusplant7374 2y ago
    About half my requests end up going to web search. But if you ask it for something specific like "find an X-ray image with an abnormality," then it refuses.

danirogerc 2y ago

Couldn't a lot of front-ends using Claude API do this already? What's new?

dcre 2y ago
If that's true, they are using a separate search API to get search results and feed it into a regular Claude API call. The difference here is that Anthropic is integrating it directly, like OpenAI and Google have. It doesn't look like it's in the API yet, but presumably that's coming. Then, as with gpt-4o and the Gemini models, you can make a single API call and it will do the searching for you and incorporate the results.
simonw 2y ago
This is a new product feature for https://claude.ai https://claude.ai and the Claude mobile and desktop apps.
quinncom 2y ago
Yes, via MCP integrations. https://www.anthropic.com/news/model-context-protocol https://www.anthropic.com/news/model-context-protocol

NBJack 2y ago

I wonder if it will actually respect the robots.txt this time.

micromacrofoot 2y ago
almost no one does, robots.txt is practically a joke at this point — right up there with autocomplete=off
- Demiurge 2y ago
  In what circles is it a joke? Google bots seem to respect it on my sites according to logs.
  - otikik 2y ago
    Apparently, the regular search crawler does it, but the ai thingie doesn't.
    - supriyo-biswas 2y ago
      Huh? You can add Google-Extended[1] to opt out from Generative AI summaries. [1] https://blog.google/technology/ai/an-update-on-web-publisher-controls/ https://blog.google/technology/ai/an-update-on-web-publisher...
      - micromacrofoot 2y ago
        Google will still scrape it for training data either way, this only impacts search results.
        supriyo-biswas 2y ago
        > Today we’re announcing Google-Extended, a new control that web publishers can use to manage whether their sites help *improve Bard and Vertex AI generative APIs*, including future generations of models that power those products.

firloop 2y ago

Any information on what search engine is powering it?

goatmeal 2y ago

kagi already lets me use claude to search the web. how is this different?

whalesalad 2y ago
kagi is searching the web for you, and then injecting the results into the context of the prompt.
- callamdelaney 2y ago
  Are there any downsides to that approach? It seems like we're moving towards empowering llm's to interact with stuff as if that's better than us doing it for them - is it really? Eg say I want to build an agent to make decisions, shall I write some code to insert the data that informs the decision into the prompt, return structured data, and then write code to implement the decision? Or should I empower the llm do those things with function calls?
  - visarga 2y ago
    If you want deeper search, it needs to be able to iterate, plan, reason while searching.

hombre_fatal 2y ago

Aside, does anyone know of an app like Perplexity for surfing the news in a foreign language (language practice)? Perplexity's "Explore" tab translates its news to your local language, and its curated news items are all pretty interesting, but the problem is that there are so few of them. I seem to get maybe a dozen stories in a day. I paid their subscription for a month just to listen to the news on my walk, but didn't renew because of this. A foreign news site like BBC Mundo (Spanish) on the other hand barely has any stories outside of a few niches. Its tech section only has a few stories per week. Hmm, maybe I want a sort of RSS reader that AI-translates stories for me. But I don't really want to maintain a feed myself either. Apple News would probably do it since they also have good curation, but afaict they still don't support foreign news sources (why???).

dolmen 2y ago
Use a VPN to appear like being in the target country. Use a browser profile where you set the language preference to the one you target.
- hombre_fatal 2y ago
  For which purpose?
  - deleted 2y ago
    [deleted]
diggan 2y ago
> Apple News would probably do it since they also have good curation, but afaict they still don't support foreign news sources (why???). ground.news includes sources from all sorts of countries, and also auto-translate headline and the intro, while you can still click to access the source article. Not affiliated, just happy user. Example with sources in English, German and French: https://ground.news/article/accident-on-the-a13-in-the-yvelines-the-results-and-profile-of-the-victims-of-the-collision-are-known_50ea75 https://ground.news/article/accident-on-the-a13-in-the-yveli... Although I'm not sure how useful it is for language learning, as you cannot (afaik) configure it to only display articles in Spanish or something similar, but if you filter by stories about France, you'll get a lot of French sources (obviously).

deleted 2y ago

[deleted]

mvieira38 2y ago

What's up with the geoblocking of Claude features? Not the first time it happens

kasey_junk 2y ago
Different geographies have different legal requirements.
artursapek 2y ago
ask the same geniuses who gave you the browser cookie popup re-implemented in a new way on every fucking website ever

itpcc 2y ago

Now I understand why Gitlab was (is?) attacked[0] by those hideous bots. [0] https://news.ycombinator.com/item?id=43422413 https://news.ycombinator.com/item?id=43422413

pcj-github 2y ago

Does not really say /how/ it's performing a web search... Is it tapping into it's "own" corpus of material or calling out to some other web search engine?

ordersofmag 2y ago
In my quick experiment (asking a question that would naturally lead to content on my own site) it is not doing a real time request to the site in question. Its answer included links back to my site (and relevant summaries), but there was no requests for those pages while it was generating its answer. So it's clearly drawing from info that has already been scraped at some earlier point. And given that I see Claudebot routinely (and politely) crawling the site I'd guess it's working from it's own scraped copies (because why use someone else's if you've got your own....)
- gizmodo59 2y ago
  Major AI players don’t want to use someone else web index as they may cut it off or jack up the prices etc. major players want to build their own web index
  - hk__2 2y ago
    And this is why we see our logs overloaded with ABot BBot CBot etc, every single "AI" company makes their own bot and they all crawl the same pages over and over.

punkpeye 2y ago

There is already a 100 ways of doing it using MCP https://glama.ai/mcp/servers?searchTerm=search https://glama.ai/mcp/servers?searchTerm=search What's the benefit of bringing native integration?

TrueDuality 2y ago
The native app that allows for MCP is only available officially on Mac's and the web interface is generally more convenient for non-technical users. Searching and interacting with the web has become a table-stakes feature and was a glaring gap in Claude.
- punkpeye 2y ago
  Let me rephrase it. MCP has the capability to add this functionality. It would be nice to see MCP getting adoption in their web UI, as well easier UX, rather than more ad hoc features being added natively.
  - masterj 2y ago
    This is likely implemented behind the scenes as an MCP server exposed to their model in the web UI. It is likely that they will enable MCP servers over HTTP+SSEs (vs the stdin/stdout used with Claude desktop) on the web version in the near future.

light_triad 2y ago

Good news. I integrated Claude with a scrapper to get info from pages and it was not giving hallucinations 99% of the time. Hope this works out of the box now.

blensor 2y ago

Funny thing is that I have the obsidian-mcp-tools installed and today claude-desktop just starting fetching stuff from the web through that because it exposes a fetch tool to claude. So this limitation is a bit arbitrary anyway.

ProofHouse 2y ago

Awesome, but I also do want to say it’s pretty sad it took this long straight up. Literally no excuse. But I’m glad they finally got to a feature that was launched more than a year ago on competitors.

McNutty 2y ago

I haven't used Claude yet, but heard many good things. So I'm surprised to see that they're so far behind on this feature.

deleted 2y ago

[deleted]

ignoramous 2y ago

These are interesting times. It wasn't long ago that a uni senior who worked for a decade+ on Google Search told me that it was hopeless anyone tries to compete with Google not because it sees a tonne of signals that helps with IR but because of its in-house AI/ML. It turns out that the org that built the ultimate AI/ML that runs rings around anything that came before it for NLP (and thus IR) was a sister team at Google Translate. It isn't inconceivable that a kid might be able to build a Google-quality web search, scalability aside, on CommonsCrawls data in a weekend. As someone who built re-ranking algorithms for a search engine built atop Yahoo! and Wikipedia (REST/SOAP) APIs back in the late 2000s as a side project (and experienced the launch and subsequent iterations of Echo/Alexa up close at Amazon), the current capabilities (of even the open weight multi-modal models) seem too good to be true. Google itself though is saved by its enormous distribution advantages afforded by Chrome (3B to 5B users) and Android (3B+), aside from its search deals with Apple and other browser vendors.

fourside 2y ago

I’ll be interested in trying it. My admittedly limited experience with this on ChatGPT has been disappointing. ChatGPT falls for the SEO content that has taken over the web. As an example, I recently travelled abroad to a popular vacationing spot and asked ChatGPT for local recommendations on what to do. When it gave me answers directly, they were pretty solid. But when it “searched the web” instead, the answers were awful. Every single result it suggested had terrible ratings. It did this repeatedly. One of those times I asked it to pick something with better ratings and it sort of improved but not by much. Of course this is another tool and maybe Claude uses better sources or a better algorithm, but in this case where there was a concrete number tied to the results, that while not perfect, aims to rate the quality of a result, it still did not filter out low quality answers. I’m not sure I trust these LLMs to do any better when there aren’t such ratings available. The available input data is just not very good, and now LLMs are being used to feed that low quality, SEO machine.

mediumsmart 2y ago

thats great - the web he has been trained on or the one from Google?

tttym 2y ago

It's like a line of platforms waiting for their own agents for web search

rgbrgb 2y ago

Is there a way to access the new web browsing capability via API?

simonw 2y ago
Not yet, and no hints as to whether that will happen or not.

sylware 2y ago

What I really would like to know: do they use a web crawler with an AI strapped to the mouse and keyboard of a javascript-ed web engine?

deadbabe 2y ago

Is no one concerned about LLMs just feeding people SEO ads as content?

ConanRus 2y ago

finally

tantalor 2y ago

It says a lot about their product vision and intended market that the example query is typescript migration question. Do they not care about typical search users? Only developers?

Matl 2y ago
I'd guess they showed that query because LLMs are a lot better at answering translation/migration type stuff without hallucinating too much.
- dontlikeyoueith 2y ago
  That's because the attention mechanism was designed for Seq2Seq models (i.e. translation in its most general form). Any other use of it is a case of "I have a hammer, so that's a nail".
picafrost 2y ago
Do users pay for LLMs? I haven't seen much concrete data indicating that they do. I don't think the casual utility gains of LLMs have gotten average people so much value that they're paying $20/mo+ for it. Certainly not for search in the age of [doom] scrolling. I would guess that Anthropic wants developers talking about how good Claude is in their company Slack channels. That's the smart thing to do.
- pixl97 2y ago
  Have you actually done any kind of study on the utility the 'average user' has received, or is this just guessing?
  - picafrost 2y ago
    I have only anecdotal data from non-technical friends and family. I’m referring to average people who may not be average users because they’re barely using LLMs in the first place, if at all. They have maybe tried ChatGPT a few times to generate some silly stories, and maybe come back to it once or twice a month for a question or two, but that’s it. We’re all colored by our bubbles, and that’s not a study, but it’s something.

jetrink 2y ago

> With web search, Claude has access to the latest events and information, boosting its accuracy on tasks that benefit from the most recent data. I'm surprised that they only expect performance to improve for tasks involving recent information. I thought it was widely accepted that using an LLM to extract information from a document is much more reliable than asking it to recall information it was trained on. In particular, it is supposed to lead to fewer instances of inventing facts out of thin air. Is my understanding out of date?

not_good_coder 2y ago
I have found that for RAG use cases where the source can be document or web data, hallucinations can still occur. This is largely driven by the prompt and alignment to the data available for processing and re-ranking.

beezle 2y ago

At this point it is probably easier to poison web pages for AI crawlers in a way that does not taint the human experience.

ilaksh 2y ago

I've been using Tavily's search API for my MindRoot agents. Seems to work fairly well and much easier to set up than Google's search API. Anyone know if there is something better? I was thinking of trying Perplexity maybe.

tgtweak 2y ago

Feels like a catch-up feature to chatgpt... honestly the biggest holdback for me on anthropic is the output token limit on sonnet... 8000 tokens max output is really limited (and 200k tokens in) compared to other offerings - especially considering that I suspect most sonnet users are not chat-users but api users.

simonw 2y ago
The output limit of Claude 3.7 Sonnet Thinking is much higher (128,000): https://simonwillison.net/2025/Feb/25/llm-anthropic-014/#a-massively-increased-output-limit https://simonwillison.net/2025/Feb/25/llm-anthropic-014/#a-m...
- tgtweak 2y ago
  This is actually very helpful to me! Thanks for posting!

bfeynman 2y ago

why does perplexity exist anymore? They were one of anthropic's biggest customers and had been finetuning claude models for search for a while.

NewJazz 2y ago

Bizarre that they choose to publish this right as a thread criticizing AI crawlers gets bumped off the front page. https://news.ycombinator.com/item?id=43422413 https://news.ycombinator.com/item?id=43422413

dewey 2y ago
There’s so many news about anything “AI” at any given moment that there will never be a perfect moment.
- NewJazz 2y ago
  But this feature directly contributes to the problem in the article I linked.

tcdent 2y ago

Searching the web is a great feature in theory, but every implementation I've used so far looks at the top X hits and then interprets it to be the correct answer. When you're talking to an LLM about popular topics or common errors, the top results are often just blogspam or unresolved forum posts, so the you never get an answer to your problem. More of an indicator that web search is more unusable than ever, but interesting that it affects the performance of generative systems, nonetheless.

Almondsetat 2y ago
>looks at the top X hits and then interprets it to be the correct answer. LLMs are truly reaching human-like behavior then
- yoyohello13 2y ago
  The longer I've been in the workforce, the more I realize most humans actually kind of suck at their jobs. LLMs being more human like is the opposite of what I want.
  - _heimdall 2y ago
    That could very well be because the jobs are effectively useless. By no means does that mean the people are, nor is what the income allows them to do. But most jobs sure do seem pointless.
    - homarp 2y ago
      https://news.ycombinator.com/item?id=36373190 https://news.ycombinator.com/item?id=36373190
    - bravetraveler 2y ago
      The work is mysterious and important
      - 2y ago

CalChris 2y ago

I find myself Googling less often these days. Frustrated with both the poor search results and impressed with the quality of AI to do the same thing and more, I think search's days are numbered. AOL lasted as an email address for quite some time after America Online ceased to be a relevant portal. Maybe Gmail will as well.

whalesalad 2y ago
Kagi has been really really good.
puttycat 2y ago
Agree and I'm pretty sure Google is seeing this drop internally in usage stats and are panicking. I'm also certain (but hope to be wrong) that because of this they'll be monetizing the hell out of every remaining piece of product they have (not by charging for it of course).
noisy_boy 2y ago
I am still googling for non-indepth queries because the AI-generated summary at the top of the results is good enough most of the time and actual results are just below in case I want to see them. For more in-depth stuff, it is LLMs by default and I only goto Google when the LLM isn't getting me what I need.
- borgdefenser 2y ago
  I notice I have been using the Google AI summary more and more for quick things. I had subscribed to Perplexity for a month to use their deep research. I think it ran out earlier this week but I am really missing it Saturday morning here. That thing is awesome. Sonnet 3.7 is more in the middle of this to me. It can help me understand all the things I found from my deep research requests. I am surprised the hype is not more for Sonnet 3.7 honestly.

joshstrange 2y ago

Massive props to Anthropic for announcing a feature _and_ making it available for everyone right away. OpenAI is so annoying in this aspect. They will regularly give timelines for rollout that not met or simply wrong. Edit: "Everyone" = Everyone who pays. Sorry if this sounds mean but I don't care about what the free tier gets or when. As a paying user for both Anthropic and OpenAI I was just pointing out the rollout differences. Edit2: My US-bias is showing, sorry I didn't even parse that in the message.

underdeserver 2y ago
It's not available for everyone.
- joshstrange 2y ago
  > Web search is available now in feature preview for all paid Claude users in the United States. It is for all paid users, something OpenAI is slow on. I pay for both and I often forget to try OpenAI's new things because they roll out so slow. Sometimes it's same-day but they are all over the map in how long it takes to roll out.
  - deivid 2y ago
    For all paid users _in America_. It's not available for me in Europe.
    - joshstrange 2y ago
      Apologies, I updated my original comment, I missed that completely.
    - DrammBA 2y ago
      I think 'For all paid users in the United States' is clearer. I live in America, but not in what the United States considers 'America', so I do not get to use this new feature yet.

g42gregory 2y ago

Anybody knows if this search will works inside Cursor? Do we need to do anything to make 3.7-thinking to search the web?

dimitri-vs 2y ago
You can already @web and have been able to for a while now. It's not very good IMO. https://docs.cursor.com/context/@-symbols/@-web https://docs.cursor.com/context/@-symbols/@-web

nimish 2y ago

So what's perplexity's raison detre at this point?

dalmo3 2y ago
I open perplexity, I see a search box. I open claude, I see a big "Continue with Google" button.

scudsworth 2y ago

"claude can now ddos random websites . . . more so"

douglee650 2y ago

You know what Claude can't do? Successfully vibe me a solution to: """ i need a bashrc command that will map the alias "logg" to open macvim to the file at ~/log.txt, then execute the macro defined by "<leader>z" """ Note <leader>z ends with user in insert mode, Claude provides solution below but puts me in edit mode. (I still have to press "i") alias loggg='mvim ~/log.txt -c "normal \<leader>z"'

simonw 2y ago
I don't find that prompt to be particularly clear.
- dcre 2y ago
  And it did exactly what the prompt asked! For all it knows, the macro could put the user in the desired mode.
- douglee650 2y ago
  I guess I am expecting too much. But dang, comment reply from simonw!

hansmayer 2y ago

So, referring specifically to the example they show on the front-page, what value does this bring actually? The best example they could come up with is Typescript migration ? Really? Weren't the LLMs supposed to be a superior alternative to searching the web? Why do we need to produce more CO2 to do the same we could have done at the fraction of the cost, of course at the time when the google search was still working?

simonw 2y ago
The CO2 concerns of using LLMs are massively overblown these days (with the exception of o1-pro and GPT-4.5 at least). The energy efficiency of most models has improved by an order of magnitude since the most widely cited CO2 usage papers were published. (It remains frustratingly difficult to get accurate numbers though: at this point I think more transparency would help rather than hurt the big AI labs)
- cube2222 2y ago
  A good recent in-depth article about this: https://andymasley.substack.com/p/individual-ai-use-is-not-bad-for https://andymasley.substack.com/p/individual-ai-use-is-not-b...
- hansmayer 2y ago
  I meant that as a side note, but even if we put the CO2 issue completely aside, I am still failing to see what is this "feature" bringing, and judging by the lame example they picked, the Anthropic are not quite sure either.

wewewedxfgdf 2y ago

I'm waiting for Claude's API to support projects with file uploads like its web UI.

ralusek 2y ago

Best models for search, in order: OpenAI Deep Research Grok Deep Search Gemini Deep Research Grok + Search Gemini + Search ChatGPT + Search These are just my opinions, but I do use this feature all the time. Haven't used Claude enough to get a sense of where it would fit in.

danielbln 2y ago
Where does Perplexity Deep Research fit into this list?

gcanyon 2y ago

Funny, I literally just two days ago asked Claude to provide an outline of the functionality of a product, giving it the web site. It of course refused. So I downloaded the text of the site and passed that in, and got mediocre results. The results based on giving the source URL directly were better. Still a bit generic and high-level and vague, as LLMs tend to be, but better than the text-download version a couple days ago. And of course much easier to generate!

MattSayar 2y ago
I had tried using monolith [0] to feed webpages into Claude but all the html was too much token context. I ended up Print > Save as PDF-ing somewhat often and that worked pretty well. But just giving a URL is ideal. [0] https://github.com/Y2Z/monolith https://github.com/Y2Z/monolith
- knowaveragejoe 2y ago
  Using the fetch MCP tool(which is very basic) works fairly well for me, though various sites will block it from time to time. https://github.com/modelcontextprotocol/servers/tree/main/src/fetch https://github.com/modelcontextprotocol/servers/tree/main/sr...
  - MattSayar 2y ago
    > though various sites will block it from time to time. The page itself describes a --ignore-robots-txt and customizing the user agent. Guess we can just all copy OpenAI and continue to make SourceHut's life miserable /s This is a cool tool, thanks for sharing
    - knowaveragejoe 2y ago
      For what it's worth, it's fetch under the hood. More akin to curl than automated scraping.

ForTheKidz 2y ago

Great, now we just need a decent search engine.

artembugara 2y ago

Search the web is apparently using SERP. It’s just breaks my head. We’ve build LLMs that can process millions of pages at a time. But what we give them is a search engine that is optimized for humans. It’s like giving a humanoid robot access to a keyboard with a mouse to chat with another humanoid robot. Disclaimer: I might be biased as we’re kind of building the fact search engine for LLMs.

sadeshmukh 2y ago
No LLM can process millions of web pages. Maybe you're thinking of something else?
braebo 2y ago
This is a problem I think about often. I’d be curious to know what kind of things you’ve learned / accomplished in that problem space so far.
ordersofmag 2y ago
What makes you think Claude is using a search engine optimized for humans?

_ea1k 2y ago

I really want these to be able to find and even redisplay images. "Search all the hotels within 5 miles of this address and show me detailed pictures of the rooms and restrooms" Hotels would much rather show you the outside, the lobby, and a conference room, so finding what the actual living space will look like is often surprisingly difficult.

dgs_sgd 2y ago
I've been looking for this as well. I want a reliable image search tool. I tried a combination of perplexity web search tool use with the Anthropic conversations API but it's been lackluster.
- deleted 2y ago
  [deleted]
- tjsk 2y ago
  I’ve been experimenting with different LLM + search combos too, but results have been mixed. One thing I’m particularly interested in is improving retrieval for both images and videos. Right now, most tools seem to rely heavily on metadata or simple embeddings, but I wonder if there’s a better way to handle complex visual queries. Have you tried anything for video search as well, or are you mainly focused on images? Also, what kinds of queries have you tested?

Taters91 2y ago

so can I

greatNespresso 2y ago

Woaw, so excited about this! Has anyone tried it out already?

ineedaj0b 2y ago

i stopped using Claude about 2 months ago. went to Grok (the code was better, everything was better - politics aside). i wonder if this update will improve it. the main issue i find with Claude is, he fights you. He refuses so many requests and i need 3 or 4 replies to get what i want vs deepseek/grok. i've kept the monthly subscription to help anthropic, but it's trounced by the free options imo.

Workaccount2 2y ago
Claude 3.7 with thinking is a big step up. If you haven't used it I'd suggest giving it a try. I have used grok a bit and it did what I needed it too, so I can't really compare. But 3.7 thinking is crazy strong for coding.
- gizmodo59 2y ago
  I got much better results with o3-mini than Claude for coding. Get the high level design wkth o3 or o1 and then use gpt4 or Claude for small tasks.
- user_7832 2y ago
  I wonder if you use it exclusively for coding, because for general purpose explanation tasks, 3.7 seems absolutely terrible unfortunately. Back when it was 3.5 you could actually talk and learn things and it felt humane, but now it sounds like a McKinsey-corpo in a suit who sounds all fancy but is only right half the time. I’ve switched back (rather regretfully) to chatgpt, and holy hell is its personality much better. For example just try asking it to explain differences between Neo Grotesque and Geometrical Sans Serif fonts/typefaces. One sounds like a friend trying to explain, the other sounds like a soulless bot. (And if you have 3.5 access, try asking it too.)
  - Workaccount2 2y ago
    I use it just for coding. For general inference I use 4.5 I think OpenAI (and likely others) are on the right to track to acknowledge that different model tunings are best for different uses, and they interned to add a discriminator that can direct prompts to the best tuned model/change model tuning in real time.

monkeydust 2y ago

Which frontier model provider let's me specific what websites to search and it will only search those?

gizmodo59 2y ago
You can just prompt ChatGPT 4o saying only get information from web
- monkeydust 2y ago
  Yes but you cant limit to a set of websites, I have tried sometimes it works but rarely and if it does search your set it will still go off and pick others. In the field I work in there are around a dozen specialist sites and I just want it to query those. Perhaps I need to develop around it.

lihua919 2y ago

great

Heidaradar 2y ago

Kinda surprised it took them this long to add this feature, but glad it's here now

stealthlogic 2y ago

[dead]

jason_zig 2y ago

Curious - does anyone want this stuff?

gavmor 2y ago
Yeah, I love this stuff! Compiling data from multiple pages into a single paragraph in the time it takes to read one page? Great stuff. I can't imagine living without Perplexity. Oh, sure, it hallucinates a lot, and in dangerous ways, but even if I have to manually corroborate all the citations, I'm still saving time, especially insofar as it reveals whether or not I'm barking, broadly, up the wrong tree. It's especially good for comparisons, because the results of two disparate search terms can be collated into the results. Could this be done without LLMs, but only vector embeddings? Hm, maybe. Algolia is maybe the 80 for 20, but does Algolia have a web index?

l33tbro 2y ago

I still don't get why Claude needs my phone number to sign up. Feels gross and is a such a shame, as their LLM seems great.

nokun7 2y ago

Honestly, while this is a great update and all, other AI platforms have had web search functionality for quite some time now. Any explanation for this delay? I wonder if Claude’s API will match Perplexity’s dynamic answers. Is there API rate limiting. If so, then the older API pricing would be preferable. Can users switch between the two?

livingmylife01 2y ago

This is insane. Guys you think it will someday replace google?

dangapeass 2y ago

[dead]

cpersona 2y ago

SEO for LLMs looks to have a bright future.

gavmor 2y ago
How do LLM queries differ from organic?

luxuryballs 2y ago

Time to ask it to find all the dirt on me?

xingwu 2y ago

Hope there will be a tech blog regarding how you index and retrieve the pages.

d--b 2y ago

Next: Claude can now ask random questions to strangers on Reddit.

n_ary 2y ago

Off-topic: Mistral already had web search enabled for a while on there free tier. Caveat: Mistral reasoning model on free tier is super slow(2-5 token/sec).

ingen0s 2y ago

Can’t believe they are making us vpn for this

herdcall 2y ago

It badly hallucinated in my test. I asked it "Rust crate to access Postgres with Arrow support" and it made up an arrow-postgres crate. It even gave sample Rust code using this fictional crate! Below is its response (code example omitted): I can recommend a Rust crate for accessing PostgreSQL with Arrow support. The primary crate you'll want to use is arrow-postgres, which combines the PostgreSQL connectivity of the popular postgres crate with Apache Arrow data format support. This crate allows you to: Query PostgreSQL databases using SQL Return results as Arrow record batches Use strongly-typed Arrow schemas Convert between PostgreSQL and Arrow data types efficiently

keeran 2y ago
This was pretty much my first experience with LLM code generation when these things first came out. It's still a present issue whenever I go light on prompt details and I _always_ get caught out by it and it _always_ infuriates me. I'm sure there are endless discussions on front running overconfident false positives and being better at prompting and seeding a project context, but 1-2 years into this world is like 20 in regular space, and it shouldn't be happening any more.
- op00to 2y ago
  Often times I come up with a prompt, then stick the prompt in an LLM to enhance / identify what I’ve left out, then finally actually execute the prompt.
- exhaze 2y ago
  Cite things from ID based specs. You’re facing a skill issue. The reason most people don’t see it as such is because an LLM doesn’t just “fail to run” here. If this was code you wrote in a compiled language, would you post and say the language infuriates you because it won’t compile your syntax errors? As this kind of dev style becomes prevalent and output expectation adjust, work performance review won’t care that you’re mad. So my advice is: 1. Treat it like regular software dev where you define tasks with ID prefixes for everything, acceptance criteria, exceptions. Ask LLM to reference them in code right before impl code 2. “Debug” by asking the LLM to self reflect on its decision making process that caused the issue - this can give you useful heuristics o use later to further reduce the issues you mentioned. “It” happening is a result of your lack of time investment into systematically addressing this. _You_ should have learned this by now. Complain less, learn more.

blazenby 2y ago

[dead]

uzyn 2y ago

Surprised that Claude (the app, not model) not only has done well for so long, but has somewhat consistently clinched the top spot in coding, all without a feature that is considered somewhat of a basic feature for most consumer-facing AI apps.

gizmodo59 2y ago
How much % it’s significant compared to say openai or google? Because if I’m paying 20$ I want other things too not just coding. And if the moat for coding compared to other vendors is not significant, it doesn’t make any difference tbh
- uzyn 2y ago
  Fair point. I wouldn't say it's by a lot because I am getting quite good results with ChatGPT's models too. A part of it could also just be confirmation bias too.

hoppp 2y ago

I just read about llm bots ddosing websites and i guess more of that is coming soon. Big money is bettin on AI eatin the web and the small fishes pay for the bandwidth.

whatever1 2y ago

Is it fair use if Claude makes google searches and then presents the results to its users ?

ggm 2y ago

So in many respects, search the place it used to construct the model? Isn't that functionally bias-reinforcing? "Look what I synthesise is correct and true because when I use the same top 10 priming responses which informed my decision I find these INDEPENDENT RESULTS which confirm what I modelled" type reasoning. None of us have a problem with an LLM which returns 2+2 = 4 and shows you 10 sites which confirm. What worries me is when the LLM returns 2+2 = 5 and shows 10 sites which confirm. The set of negative worth content sites is semi infinite and the set of useful confirmed fact (expensive) sites is small so this feels like an outcome which is highly predictable (please don't beat me up for my arithmetic) e.g. "Yes Climate science is bunk" <returns 10 top sites from paid shills in the oil sector which have been SEO'd up the top>"

shortrounddev2 2y ago
We will very quickly enter a Kepler effect of information on the internet. All text on the internet will become AI slop being parsed by AI. Real information and human beings will be drowned out by the garbage. The internet will cease to be useful and we will retreat to corners of the web or to walled gardens. I'm seeing more and more online communities these days enforce invite only because there's just too much AI slop everywhere now.
- importantstuff 2y ago
  Do you mean Kessler syndrome by any chance?
  - shortrounddev2 2y ago
    Yes! And I would edit my original comment if HN wasn't such a POS site!

notepad0x90 2y ago

if everyone is using LLMs to solve problems, in a few years, won't LLMs run out of content to mine? In short, how can the general dumbing down of LLMs and degradation of content used to solve problems be avoided over the long term? For questions about events and problems that arose after 2025, where would LLMs get information to solve those? and who would be asking those at a forum LLMs can access going forward? Is the snake eating it's own tail?

kadushka 2y ago
1. People will continue to answer questions and post about events and problems after 2025. Eventually LLMs themselves (inside robots) will be observing the world and reporting on anything interesting. 2. Best LLMs today answer questions better than 90% of people who comment on forums. So if these LLMs have been able to train on all the crap posted on internet so far, they should only get better as they are being trained on high quality output from the latest (and future) LLMs.
visarga 2y ago
Most interesting data will be collected in chat rooms and apps. There are over a billion LLM users, they act as human-in-the-loop enhancig the LLM, sometimes testing ideas even in reality. Wondering what providers are doing with the chat logs.

stephencoyner 2y ago

When I try to prompt it with something that obviously needs up to date web search (when will Minneola Tangelos be in season this year?) it says.. "I believe they're usually available from November through March, but I'm not completely certain about the exact timing for this year's crop. Would you like me to search for more current information about the 2025 tangelo season?" It doesn't just search, it wants me to confirm. This has happened a lot for me.

themagician 2y ago

What is there to even search anymore? Almost everything is gated, and whatever remains public is connected a faucet that pumps out AI slop at an ever increasing rate. The internet consumed itself. Telling someone to, "Just Google it," is now terrible general advice.

bosky101 2y ago

We need a way to collapse comments on HN

krapp 2y ago
see the "[-]" link in the comment header? That's what it does.
4ggr0 2y ago
> created: February 20, 2007 i hope you're trolling mate, got an account since 18 years and never wondered what the [-] button does? :D
bosky101 2y ago
OMG!

zxvkhkxvdvbdxz 2y ago

Wake me up when we go back to discussing progress, instead of being wooed by fake toddlers doing tricks badly.

AzzyHN 2y ago

They never watched Avenger's 2

DeathArrow 2y ago

Do they have their own search engine or use an external one. If they use Google I would worry about relevance.

Tewboo 2y ago

This is a huge step forward for AI. Can't wait to see how Claude integrates with other apps.

startifyai 2y ago

[dead]

joeeverjk 2y ago

Funny how we’ve come full circle—LLMs now search the web to answer queries, which is what search engines did originally. The difference? Now the hallucinations come with citations. Curious how long until "web search" just means summarizing Reddit threads again.

mbs159 2y ago

Will this work for people using Claude through other services like OpenRouter?

iamflimflam1 2y ago

I generally have to resort to telling ChatGPT “do not search the web”. ..

ksajadi 2y ago

I can hear the sigh of relief from "SEO gurus" from here...

Cort3z 2y ago

I usually find Claude to be my favourite flavor of LLMs, but I still pay for ChatGPT because their voice offering is so great! I regularly use it as an "expert on the side" when I do other things, like doing bike repairs. I ask it things like "how do I find the min/max adjustments on my particular flavor of front derailleur", or when cooking, and my hands are dirty, I can ask stuff like "how much X do I usually need for Y people", and so on. The hands-off feature is so great when my hands are literally busy doing some other thing. I really wish Claude had something similar.

eraserj 2y ago
> There's less usage of voice mode on the enterprise and power users side but that will happen eventually. - Anthropic CEO 21 jan. [0] [0] https://youtu.be/snkOMOjiVOk https://youtu.be/snkOMOjiVOk 01:30
mock-possum 2y ago
ChatGPT advanced voice mode really is surprisingly excellent - I just wish it: 1) would give you more time to pause when you’re talking before it immediately launches into an answer 2) would actually try to say the symbols in code blocks verbatim - it’s basically useless for looking up anything to do with code, because it will omit parts of the answer from its speech.
- barfingclouds 2y ago
  Yeah I have to manually hold it down every time I talk. I have a lot of pauses and simply would not be able to interface with that without that option. It’s why I essentially can’t use Gemini voice mode
lamtung 2y ago
Is it possible to use ChatGPT voice feature in a similar manner to Alexa where I only need to say an activation word? I’m aiming to set up a system for my 7-year-old son to let him engage in conversations with ChatGPT as he does with Alexa.
- 2y ago

andreygrehov 2y ago

Two things. 1. I generally prefer that an LLM not search the web. The top N results are often either SEO spam, excessively long articles created solely to rank well, or long-established websites that gained authority years ago, when Google's crawler and ranking algorithms were less sophisticated. 2. Web search by LLMs is likely here to stay, so I'm curious whether there's an agent-friendly web format. For example, when an RSS reader visits a website, the site responds with an RSS feed. I think we need something similar for agents - an open standard that all websites would support. This could reduce processing overhead and potentially improve the accuracy of the information retrieved. Thoughts?

mstaoru 2y ago
You already answered #2 with #1. The standard will be gamed.
- andreygrehov 2y ago
  But the purpose of the standard isn't to rank websites, but to process the information.

dankobgd 2y ago

wow so cool and usefull, said nobody ever

BrouteMinou 2y ago

I, too, can search the web. We finally went full circle? LLM is used as a search engine?

agentultra 2y ago

They need to stop or else make their crawlers easy to identify and block. However I have no faith that AI companies will play by the rules. They already cost people time, money, and their mental health by using adversarial tactics to evade blocking and ignoring robots.txt https://drewdevault.com/2025/03/17/2025-03-17-Stop-externalizing-your-costs-on-me.html https://drewdevault.com/2025/03/17/2025-03-17-Stop-externali...

enveks 2y ago

[dead]

dostick 2y ago

Anyone noticed that if you enable the “browse internet” in ChatGPT, it becomes very dumb? It abandons all its intelligence and produces mostly incorrect results. Like it’s being passive-aggressive, “Oh, you don’t like me as I am and want to augment me with search, let me show you how it is if my brain was only search!”

deleted 2y ago

[deleted]

BaculumMeumEst 2y ago

Can you search the web for probable corrections to broken links? Has anyone had luck doing this with a web enabled model?

mocmoc 2y ago

Please , make your context window bigger , if you do that … that’s it sonet 3.7 it’s amazing but it can’t even finish a dashboard because of that

simonw 2y ago

The search index is provided by Brave: https://simonwillison.net/2025/Mar/21/anthropic-use-brave/ https://simonwillison.net/2025/Mar/21/anthropic-use-brave/ - Brave is now listed as a subprocessor on the Anthropic Trust Center portal - Search results for "interesting pelican facts" from Claude and Brave were an exact match - If you ask Claude for the definition of its web_search tool one of the properties is called "BraveSearchParams"

sebmellen 2y ago
Remarkably, it looks like Brave will survive even while Basic Attention Token is essentially dead. What an interesting pivot.
sumeno 2y ago
Very disappointing, Brave is the last company I want my data going to
- newswasboring 2y ago
  Why? I am not aware of what's wrong with them.
  - sumeno 2y ago
    https://en.wikipedia.org/wiki/Brave_(web_browser)#Controversies https://en.wikipedia.org/wiki/Brave_(web_browser)#Controvers...
- exhaze 2y ago
  Install MCP plugin and call a search engine of your choice. If you’re unhappy about something, try to first think of a solution before expressing your discontent.
  - sumeno 2y ago
    Wow, so condescending I don't use the desktop app and I don't want to use the desktop app or jump through a bunch of hoops to support basic functionality without having my data sent to a sketchy company.

dunefox 2y ago

A bit OT: does anyone have experiences with Mistral AI as a comparison to OpenAI or Anthropic? I would like to stay with a European company, if they're somewhat equivalent.

simonw 2y ago
I really like the Mistral openly licensed models - Mistral Small 3 is my current favourite local model to run, but only because I've not spent enough time with the brand new Mistral Small 3.1 to recommend it yet (I expect it will be promoted to my favourite local model soon.) Their user-facing product at https://mistral.ai/ https://mistral.ai/ seems good to me - it uses Brave for search (same as Claude does) and has a "canvas" feature similar to Claude Artifacts. I've not spent enough time with that to evaluate if it could be a good daily-driver or not though. My hunch is that Claude 3.7 Sonnet is still _massively_ better for code, based on general buzz online and a few benchmarks I've seen.

pixelkink 2y ago

Not to sound snarky but Anthropic introduced function calling over a year ago... The capability was always there for someone that wanted to spend a weekend coding a tool for it. https://www.anthropic.com/news/claude-3-family?_hsenc=p2ANqtz--7E9rghpH8hgDEBV2C5pyiXXeAIJY6LnrVppijwY-3E1T3PURd5sLMLgkuo5131igbto6Y https://www.anthropic.com/news/claude-3-family?_hsenc=p2ANqt...

mark_l_watson 2y ago
I agree. I have been integrating Brave search and DuckDuckGo search with LLMs for about a year. That said it is so much more convenient having an option of having it built in. I stopped paying for Perplexity a year ago, but a month ago I started using Perplexity's combined search+LLM APIs - reasonably priced and convenient.

hackburg 2y ago

[dead]

rmwa 2y ago

Finally - but it will make Claude even better for coding

deleted 2y ago

[deleted]