4 ms·

Suppose I'd like to use models like this one to perform web searches. Is there anything available in the open-source world that would let me do that without muc

Suppose I'd like to use models like this one to perform web searches. Is there anything available in the open-source world that would let me do that without much tinkering needed? I think it’s something that even Google should consider: publishing open-source models with the possibility of grounding their replies in Google Search.

vorticalbox 1y ago
I have been using ollama + open web ui. open webUI already have a web search tool all you would need to do is click the toggle for it under the chat.
- zettabomb 1y ago
  Unfortunately the OWUI web search is really slow and just not great overall. I would suggest using an MCP integration instead.
  - thimabi 1y ago
    Can you recommend a specific piece of software for using an MCP integration for web searches with local LLMs? That’s the first time I’ve heard of this.
    - nickthegreek 1y ago
      i think the ones i’ve heard mentioned on youtube use an mcp that interfaces with searxng.
joerick 1y ago
Google do have an API for this. It has limits but perfectly good for personal use. https://developers.google.com/custom-search/v1/overview https://developers.google.com/custom-search/v1/overview
- thimabi 1y ago
  Unfortunately 100 queries per day is quite low for LLMs, which tend to average 5-10 searches per prompt in my experience. And paying for the search API doesn’t seem to be worth it compared to something like a ChatGPT subscription.
  - sadeshmukh 1y ago
    The Google programmable search engine is unlimited and can search the web: https://programmablesearchengine.google.com/about/ https://programmablesearchengine.google.com/about/
    - yorwba 1y ago
      That's intended for human users. If you try to use it for automated requests, you'll get banned for botting fairly quickly.
      - sadeshmukh 1y ago
        They have a 10k/day API. I'm sure that's enough for one person.
        yorwba 1y ago
        That's the one that's described upthread as "paying for the search API doesn’t seem to be worth it."
  - gkbrk 1y ago
    You're not limited to 100 queries per day though. You're limited to 10,000 queries per day.
    - scrivna 1y ago
      10k queries would cost $50/day

vorticalbox 1y ago

I have been using ollama + open web ui. open webUI already have a web search tool all you would need to do is click the toggle for it under the chat.

zettabomb 1y ago
Unfortunately the OWUI web search is really slow and just not great overall. I would suggest using an MCP integration instead.
- thimabi 1y ago
  Can you recommend a specific piece of software for using an MCP integration for web searches with local LLMs? That’s the first time I’ve heard of this.
  - nickthegreek 1y ago
    i think the ones i’ve heard mentioned on youtube use an mcp that interfaces with searxng.

joerick 1y ago

Google do have an API for this. It has limits but perfectly good for personal use. https://developers.google.com/custom-search/v1/overview https://developers.google.com/custom-search/v1/overview

thimabi 1y ago
Unfortunately 100 queries per day is quite low for LLMs, which tend to average 5-10 searches per prompt in my experience. And paying for the search API doesn’t seem to be worth it compared to something like a ChatGPT subscription.
- sadeshmukh 1y ago
  The Google programmable search engine is unlimited and can search the web: https://programmablesearchengine.google.com/about/ https://programmablesearchengine.google.com/about/
  - yorwba 1y ago
    That's intended for human users. If you try to use it for automated requests, you'll get banned for botting fairly quickly.
    - sadeshmukh 1y ago
      They have a 10k/day API. I'm sure that's enough for one person.
      - yorwba 1y ago
        That's the one that's described upthread as "paying for the search API doesn’t seem to be worth it."
- gkbrk 1y ago
  You're not limited to 100 queries per day though. You're limited to 10,000 queries per day.
  - scrivna 1y ago
    10k queries would cost $50/day