3 ms·
The linked article describes an attack against NotebookLM, which is limited to people who deliberately create a Notebook that includes the URL of the page with
by simonw 2y ago
The linked article describes an attack against NotebookLM, which is limited to people who deliberately create a Notebook that includes the URL of the page with the attack on it.
I had a go at something a bit more ambitious a few weeks ago.
If you ask Google Gemini "what was the name of the young whale that hung out in pillar point harbor?" it will tell you that the whale was called "Teresa T".
Here's why: https://simonwillison.net/2024/Sep/8/teresa-t-whale-pillar-point/ https://simonwillison.net/2024/Sep/8/teresa-t-whale-pillar-p...
(Gemini used to just say "Teresa T", but when I tried just now it spoiled the effect a bit by crediting me as the person who suggested the name.)
- hackernewds 2y agoGoogle employee read your comment and quickly fixed it OR Gemini read your comment and quickly fixed it.
- input_sh 2y agoOr it's just non-deterministic, like with every LLM.
- hackernewds 2y agoSays Teresa T for me, but also links your article
- jadtz 2y agoFor me the response was just: ```The young whale that visited Pillar Point Harbor in 2024 was named Teresa T. It was a humpback whale that ventured into the harbor, likely by accident.```
- DrAwesome 2y agoInteresting! I got no citation/link until I clicked the "Double-Check Response" button, it just replied "The young whale that hung out in Pillar Point Harbor was named Teresa T." One of the drafts had a little more: "Teresa T is the name of the young humpback whale that was spotted in Pillar Point Harbor. She made headlines in September 2024 when she was seen swimming near the shore, drawing crowds and causing excitement among local residents."
- fastball 2y agoHas anyone else named the humpback? If not, isn't "Teresa T" its actual name? As the first person to bother, you get dibs.
- simonw 2y agoI saw one news story that called it "Pillar".
- Lockal 2y agoThere are (at least) 2 completely different public endpoints called as "Gemini": 1) https://gemini.google.com/ https://gemini.google.com/ - this one just searches in Google with current language/region/safe-browsing settings and personal adjustments and rewrites top search results as an answer. Generative capabilities are basically not used. 2) https://aistudio.google.com/ https://aistudio.google.com/ - here you can select specific version and generate response with LLM. Retrieval Augmented Generation (i. e. Google Search) is not used. I suppose you used #1, that's why you cave the correct result. #2 fails. There is a huge group of question where you can immediately find the answer, but LLM struggles. Another question (as example) is "What was the intended purpose of the TORIFUNE satellite in The Touhou Project?". OpenAI has something similar, providing https://www.bing.com/chat https://www.bing.com/chat for RAG and https://chat.openai.com https://chat.openai.com for an actual LLM.
- simonw 2y agoYes, in this case I meant the Gemini search-enabled user-facing product, not the model itself.