4 ms·
Are you worried about Google's response to this? Google reportedly reacts to distillation attempts "with real-time proactive defenses that can degrade student m
by varenc 5mo ago
Are you worried about Google's response to this? Google reportedly reacts to distillation attempts "with real-time proactive defenses that can degrade student model performance". So if they detected you, they could have intentionally fed you a dumber but plausible variant of Gemini: https://cloud.google.com/blog/topics/threat-intelligence/distillation-experimentation-integration-ai-adversarial-use#:~:text=Google%20continuously%20detects%2C%20disrupts%2C%20and%20mitigates%20model%20extraction%20activity%20to%20protect%20proprietary%20logic%20and%20specialized%20training%20data%2C%20including%20with%20real%2Dtime%20proactive%20defenses%20that%20can%20degrade%20student%20model%20performance. https://cloud.google.com/blog/topics/threat-intelligence/dis...
But also, this model is small and just focusing on the tool use. In terms of token usage, you're probably not anywhere near the people that are trying to distill the entire model.
- madduci 5mo agoWell, it's like robbing the robbers, when it comes to training data
- tommica 5mo agoExcept one of the robberers is a massive corporation with even bigger legal team...
- incrudible 5mo agoIt is more like imitating the imitators. There is not much of a legal case here, but poisoning the data is fair game both for those producing original data as well as for those producing its regurgitations.
- worthless-trash 5mo agoI think its very hard for the 'websites' to poison the data for ai though, we dont have the 'single point of ingestion' to measure when its being pumped for training data.
- andai 5mo agoGive visitor a test. If user fails, user probably human.
- wordsarelies 5mo agowell... really thank the courts... the creator of the prompt gets to own the output...
- varenc 5mo agoThis perspective is more cut and dry when its someone like OpenAI scraping the whole internet explicitly for LLM training purposes. But Google has already been scraping the entire internet for 25+ years. At what point did building a smarter search engine transition from indexing, to 'robbing'? And it's not like training Gemini is the first time they used their internet cache to build AI. AI, as academics use the term, has been in use on Google results for a long time. Basically, if we were okay with Google scraping the internet to build a search index, what is the line they crossed that turned this from acceptable search engine indexing, into theft?
- janalsncm 5mo agoYou could run Gemma models locally to distill them. Or any other model with tool use.
- HenryNdubuaku 5mo agoYeah, but we wanted Gemini
- deleted 5mo ago[deleted]