4 ms·

OpenAI Rolls Out Plugins and Web Browsing to All ChatGPT Plus Users

20 points by cube2222 3y ago

jstx1 3y ago
This is great news, more stuff to tinker with. What search engine does the search plugin use?
- pixl97 3y ago
  I guess I also am wondering when GPT requests your website to summarize, what agent shows up... And how long before people start to exploit that.
  - ericlewis 3y ago
    Ask and you shall receive: `Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ChatGPT-User/1.0; +https://openai.com/bot https://openai.com/bot`
- mustacheemperor 3y ago
  I asked ChatGPT how the browser plug-in works recently (so, take this with a grain of salt) and it claimed there is no actual web connected search engine in use, instead it has a “simulated browser” connected to something like a vector database of a recent snapshot of large parts of the web captured by OpenAI. Seems odd when the Bing bot already connects to the real internet, but also seems like a weirdly contradictory thing for it to hallucinate.
  - ericlewis 3y ago
    I doubt that. First, here is it’s prompt: You have the tool browser with these functions: search(query: str, recency_days: int) Issues a query to a search engine and displays the results. click(id: str) Opens the webpage with the given id, displaying it. The ID within the displayed results maps to a URL. quote(start: str, end: str) Stores a text span from an open webpage. Specifies a text span from the open webpage by a starting substring start and an ending substring end. back() Returns to the previous page and displays it. scroll(amt: int) Scrolls up or down in the open webpage by the given amount. open_url(url: str) Opens the given URL and displays it. Please render citations in this format: oaicite:{"index":0,"invalid_reason":"Malformed citation 【{message idx}†{link text}】"} Second, there is a paper on a very similar sounding tool from OpenAI: https://openai.com/research/webgpt https://openai.com/research/webgpt I would guess it is likely a version of WebGPT in plug-in form. Edit: Just had it access an ngrok address I setup and the user agent is: `Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ChatGPT-User/1.0; +https://openai.com/bot https://openai.com/bot`
PeterStuer 3y ago
Haven't gotten the web browsing mode to successfully do a search yet. I guess their side of the search has been severely overloaded? I know it is beta. Let's hope this clears.
- ericlewis 3y ago
  Simple stuff like "what are good places to eat in _____ city" will trigger search.
  - PeterStuer 3y ago
    I mean it tries to initiate the search, then fails with an error message.
andrewstuart 3y ago
What are the security implications?
- purplecats 3y ago
  some parts of your convo can be sent to third parties, without informing you of it prior to doing it
dzhiurgis 3y ago
Can't use it to write a scraper or playwright test yet - it's not able to interact with page unfortunately. Hope someone is working on it. Edit: maybe in future llm can be the tester itself and walk thru poorly written, plain language test cases

20 points by cube2222 3y ago

jstx1 3y ago

This is great news, more stuff to tinker with. What search engine does the search plugin use?

pixl97 3y ago
I guess I also am wondering when GPT requests your website to summarize, what agent shows up... And how long before people start to exploit that.
- ericlewis 3y ago
  Ask and you shall receive: `Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ChatGPT-User/1.0; +https://openai.com/bot https://openai.com/bot`
mustacheemperor 3y ago
I asked ChatGPT how the browser plug-in works recently (so, take this with a grain of salt) and it claimed there is no actual web connected search engine in use, instead it has a “simulated browser” connected to something like a vector database of a recent snapshot of large parts of the web captured by OpenAI. Seems odd when the Bing bot already connects to the real internet, but also seems like a weirdly contradictory thing for it to hallucinate.
- ericlewis 3y ago
  I doubt that. First, here is it’s prompt: You have the tool browser with these functions: search(query: str, recency_days: int) Issues a query to a search engine and displays the results. click(id: str) Opens the webpage with the given id, displaying it. The ID within the displayed results maps to a URL. quote(start: str, end: str) Stores a text span from an open webpage. Specifies a text span from the open webpage by a starting substring start and an ending substring end. back() Returns to the previous page and displays it. scroll(amt: int) Scrolls up or down in the open webpage by the given amount. open_url(url: str) Opens the given URL and displays it. Please render citations in this format: oaicite:{"index":0,"invalid_reason":"Malformed citation 【{message idx}†{link text}】"} Second, there is a paper on a very similar sounding tool from OpenAI: https://openai.com/research/webgpt https://openai.com/research/webgpt I would guess it is likely a version of WebGPT in plug-in form. Edit: Just had it access an ngrok address I setup and the user agent is: `Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ChatGPT-User/1.0; +https://openai.com/bot https://openai.com/bot`

PeterStuer 3y ago

Haven't gotten the web browsing mode to successfully do a search yet. I guess their side of the search has been severely overloaded? I know it is beta. Let's hope this clears.

ericlewis 3y ago
Simple stuff like "what are good places to eat in _____ city" will trigger search.
- PeterStuer 3y ago
  I mean it tries to initiate the search, then fails with an error message.

andrewstuart 3y ago

What are the security implications?

purplecats 3y ago
some parts of your convo can be sent to third parties, without informing you of it prior to doing it

dzhiurgis 3y ago

Can't use it to write a scraper or playwright test yet - it's not able to interact with page unfortunately. Hope someone is working on it. Edit: maybe in future llm can be the tester itself and walk thru poorly written, plain language test cases