3 ms·

The hosted ones still have the advantage of being able to search the internet for live info rather than being limited to a knowledge cut off date.

darepublic 5mo ago
Local ones that support tool use can do the same
gbear605 5mo ago
I’m not sure why a model needs to be hosted in order to make network calls?
- hansvm 5mo ago
  Is there a library of good tools for LLMs to call? I have to imagine the bot-detection avoidance mechanisms are a major engineering effort and not likely to work out of the box with a simple harness and random local LLM.
  - ossa-ma 5mo ago
    Even the hosted ones are blocked from searching certain sites, for example Claude is banned from searching Reddit: `Error: "The following domains are not accessible to our user agent: ['reddit.com']."`
  - wyre 5mo ago
    Tavily, Exa, Firecrawl, Perplexity, and Linkup are all tools for agents to search the web. I’ve been building a harness the past few months and supports them all out of the box with an API key.
    - goosejuice 5mo ago
      Kagi also has an API. People who hate ads are probably the same folk that should be paying for Kagi. That's the sane alternative world where companies respect their users.
      - wyre 5mo ago
        Oh, you got me so excited. I've had a Kagi sub for 3 years, but their API is still in closed beta. I guess I could (and should reach out and ask for access).
    - lukewarm707 5mo ago
      be warned though: firecrawl: "if you post content or intellectual property within the Services or give us Feedback about the Services, you hereby grant to us a worldwide, irrevocable, non-exclusive, royalty-free license to use, reproduce, modify, publish, translate and distribute any content that you submit in any form [...] You also grant to us the right to sub-license these rights" exa: "Query Data is used to improve our products and technology, including by training and fine-tuning models that power our Services" perplexity: "Perplexity may retain, copy, distribute and otherwise use Search Data for its lawful business purposes, including the improvement and development of products and services." linkup: "Client grants Linkup a worldwide right to use, reproduce and modify the Client Data, including prompts, for the purposes of providing, maintaining, developing, training" tavily: "we may use certain portions of your query data to improve our responses to future queries"..."We may share your query data with third-party search index providers (e.g., Google)"
  - gbear605 5mo ago
    If your volume is low enough, it should be pretty fine. It can just piggy back onto your personal browser cookies for Cloudflare.
eightysixfour 5mo ago
You can do that locally too!
chrisweekly 5mo ago
That's not how it works. Whether local or hosted, every modern model has a cutoff date for its training data, and can be leveraged by agents / harnesses / tools to fetch context from the internet or wherever.

darepublic 5mo ago

Local ones that support tool use can do the same

gbear605 5mo ago

I’m not sure why a model needs to be hosted in order to make network calls?

hansvm 5mo ago
Is there a library of good tools for LLMs to call? I have to imagine the bot-detection avoidance mechanisms are a major engineering effort and not likely to work out of the box with a simple harness and random local LLM.
- ossa-ma 5mo ago
  Even the hosted ones are blocked from searching certain sites, for example Claude is banned from searching Reddit: `Error: "The following domains are not accessible to our user agent: ['reddit.com']."`
- wyre 5mo ago
  Tavily, Exa, Firecrawl, Perplexity, and Linkup are all tools for agents to search the web. I’ve been building a harness the past few months and supports them all out of the box with an API key.
  - goosejuice 5mo ago
    Kagi also has an API. People who hate ads are probably the same folk that should be paying for Kagi. That's the sane alternative world where companies respect their users.
    - wyre 5mo ago
      Oh, you got me so excited. I've had a Kagi sub for 3 years, but their API is still in closed beta. I guess I could (and should reach out and ask for access).
  - lukewarm707 5mo ago
    be warned though: firecrawl: "if you post content or intellectual property within the Services or give us Feedback about the Services, you hereby grant to us a worldwide, irrevocable, non-exclusive, royalty-free license to use, reproduce, modify, publish, translate and distribute any content that you submit in any form [...] You also grant to us the right to sub-license these rights" exa: "Query Data is used to improve our products and technology, including by training and fine-tuning models that power our Services" perplexity: "Perplexity may retain, copy, distribute and otherwise use Search Data for its lawful business purposes, including the improvement and development of products and services." linkup: "Client grants Linkup a worldwide right to use, reproduce and modify the Client Data, including prompts, for the purposes of providing, maintaining, developing, training" tavily: "we may use certain portions of your query data to improve our responses to future queries"..."We may share your query data with third-party search index providers (e.g., Google)"
- gbear605 5mo ago
  If your volume is low enough, it should be pretty fine. It can just piggy back onto your personal browser cookies for Cloudflare.

eightysixfour 5mo ago

You can do that locally too!

chrisweekly 5mo ago

That's not how it works. Whether local or hosted, every modern model has a cutoff date for its training data, and can be leveraged by agents / harnesses / tools to fetch context from the internet or wherever.